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- . • , • CHAPTER 1 : INTRODUCTION 

The Far West School offers a program of Experience-Based Career Education, 
(EBCE) to high school studen^sHn Oakland, 'California, ^T^is report presents 
the findings of an evaluation of the Far West EBCE program conducted during the 
schoolj^year 1973-74 • " ^ . ' ' > 

Far West School is pperatecl by the Far West Laboratory for Educatic^nal • 
Research and Development '(FWL) in cooperatioj^ with the Oakl^and Public Schools. 
The suminative evaluation* reported in- this document was conducted by the Re- 
search and Evaluation staff of the FWL-EBCE Project, following guidei]ines pro- 
vided by the National Institute, of Education.. Formative evaluatipn was an in- 
tegral part of the' program development prbcess^and, as such,. was ^primarily the 
nes^nsibility of the .deve-lopment staff, supppfted by research a^nd evaluation. 

' An overview of the FWL-EBCE nwdel is presented below,. followed by a descrip 
tion of the evaluation design and related activities. 

OVERVIEW OF FWL-EBCE ^ - ^ ^ ' " , 

The, Far West Laboratory EBCE prototype is a voluntary alternative program 
^ of comprehensive, individualized learning,. focusing (\n direct experience in a 
variety of community settings-, to prepare high school students to enter and 
function successfully in the adult world. * * 

While focusing on the knowledge and skills a person needs to choose, enter, 
advance, and find satisfaction in a career, EBCE also attempts to provide tha 
essentials of a sepohdary education by allowing students to pursue traditional 
academic subjects and develop basic skills through expei;^iential Jearning-- 
applying concepts and solving real problems in a functional context. 

More specifically, a planned, integrated, and cumulative series of exper-** 
iences, in ci' wide variety of life*and work settings, is, designed to provi(^e each 
student with: , " , 



The terminology and distinction -made between suiwiative anid formative eviilua^ 
tidn -is employed only sparingly in'this report, due. to the'substantial overlap 
between the two terms. For purposes of this- report. Chapter 5, Model Develop- 
ment and Implementation, can be considered as the operational definit^ion of 
formative evaluation, emphaaiiC^ing evidence aimed primarily at improving th^^ \ 
program. Chapter 3, Program Outcome "Data, can-be looked on as sunyative, em- 
phasizing overall effects of the program relative tJS program goals and objec- 
tives. . ' ^ ' m- ' ' 



1, self-knowledges -real istic aspiralfions based on accurate appraisals 
of bis or her interests, needs, 'values, and goals; 

2, a'broad understanding of the world- of work- -first-hand information 
about its 'obligations, rewards shortcomings , and requirements; - 

3, fundamental coping skill s- -acadeinic> interpersonal , ftblem-sol ving, 
aVid dec^'sion-making— necessary for functioning effectively as a ^ 
social being in the modern world, - . 

■ " ■ p' 

Upon graduation, students receive accredited diplomas thrqugh the Oakland 
Public Schools (QPS), and should have the knowledge and skills necessary to , 
' enter college,^ training programs, or ,to seek employment. 

The program relies on the active participation of a broad representation * 
of the entire community— -local schools and agencies, working individuals, 
parents, and employer organizations. * 

Far West Schob'l learning resources are categorized as follows-: 

* Resource Person , An adult in a work setting who volunteers to share his 
occcipa|:ional know-how, seasoned knowledge and skills,^ his interests, and per- 
haps his hobbies with a student in a one-to-one relationship. These relation- 
ships can vary from a single day's exploitation to weeks or months of intensive 
involvement. A. resource person'-mciy be a machinist, a lawyer, a journalist, a 
printer, a books.tore owner, 4a business executive, city manager, director of • 
a day-care cfenter, a furniture salesman, or a carpenter, . * ' 

Resource Organization . An employer organization that makes its facilities * 
and staff avjailable to groups of'students for series of pre-planned learning 
activities. These activities are-designed to acquaint students with the nature 
and functions of an entire organization, the interrelationship of jobs and tasks, 
and to provide them with a variety of hands-on exp^erience. 

community Resource . Those places, agencies; and facilities available to 
the public, such as museums, courts, city hall,- and so forth, that provide a?i- 
ditional learning experiences to broaden a student's understanding and per-, 
spective of the community at large'. 

These resources are assembled around career or subject areas in course- 
like groupings, called packages . The package framework serves to stimulate,, 
focus," and facilitate the planning of individual projects . 

Students are to work on specific projects that they plan with one of the 
three learning coordinators at the school site in a downtown Oakland office 
building. Each learning coordinator acts as a combination instructor-counselor 
who decides with the student what type and amount 'of credit can be obtained ' 
tLrough successful completion of a project. Students may pursue activites at 
any of three levels: 

O 2 . ■ 
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"Orientatiori , One to ten hours to acquain^t students with' a resource 
person, his/her career, and work in a given organization. Activities in- 
clude guided tours K.question-and-answer^essions, or meetings with staff who 
are carrying out their daily worki 

Exploration > Ten to forty hours to permit students to study in greater ' • 
detail an occupation, an issue, or a subject. Students produce some^ tangible 
results, such as a research report, an oral description of an occupation or 
profession, or a photographi c essay. 

Investigation , Forty or more hours to include on-site' training or more 
intensive personal involvement in performing productive tasks and assignments, 
plus thorough study of related materials. , 

It may not be po-ssibife^ for students to fulfilT^a^l their high-school .grad- 
uation requirements during career exp.loration. To supplement its program. 
Far West School offers tutoring to students as n.eeded. Experienced tutors pro- 
vide supplementary help, in writing skills, reading comprehension, spelling, ba- 
sic math, alg'^ra, geometry, and trigonometry. Tutorial sessions are offered to 
both individuals and sma^ll groups. In these sessions stu(ients usfe programniod 
texts and other tutorial materials, as well as receiving direct teaching help. 
To the -extent p'ossible, work on basic skills is integrated with project activities 

' At the time^ of enrollment, all students are evaluated through grade- 
placement tests, examination'of transcripts, and judgment of student ability 
by learning. coordinators . During the year, further evaluation of student 
products and se.lf-detennination of student needs may lead to a revised schedule 
of*tutoring assistance, , ' • 

4 

OVERVIEW OF DESIGN 

Early in the development of the EBCE program, five "^oals^were defined 
with the intention to create an educational program thatj: 

1. represents a viable, c/omprehensive alternative to other secondary 
programs; ^ / * ^ % 

2. makes education more relevant to "life in general and to adult 
employment in, parti cul ar; 

3. integrates general, adaUemtc, and vocational preparation of each 

• student; . - ^ ' ; ^ 

4. broadens the base of community participation, especially to include 
the employing sector; and , ^ 
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5, broadens the base of studei^t participation in determining 
the direction and nature of the educational process,* 

This se.t of goal statements, while in no v;ay outdated, has been sue- 
ceeded by other sets that represent elaborations or extensions in. attempts 
tp cover the developing, project,/or to describe the developing. project ^rith 
somewhat more specific statements toward which evidence might' be gathered. " 
A serious attempt was made to* collect evidence to explore the following 
statements as representing'' the major ^pals for the 1973-74 project evalua- ' 
tiort. Stated simply, they are: ' , » ^ \ 

students wil.l progress in seTf-development, including under- 
standing of^the'ir current interests, abilities, values, and 
' " limitaUions 'relevant to^^goal selection and achievement; self- 
reliance; and ability id function responsibly and independ- 
ently; ^ * ' ^ ' 

2. students will progress in career development, including 
career awareness ^and planning;' 

3. / students will progress in development of interpersonal skills; 

I 4. students will make normal^ progress irr development of basic 
^skills, including communications skills, reading skills,^and 
math skills;-^ 

5. students will make normal progress, toward completion of re- 
quirements for credits and toward graduati'on; 



.i 



6. a high proportion of students. wtll stay with scho^ol; and 

7. the program will achieve community participation and accepta^S^. 

Program emphasis for students is (l) on self-development, .self reliance, 
and independence; (2) on devel6*pment -of career awareness and* planning skills; 
(3) on. development of interpersonal skills; and (4) on fostering ^positive at- 
titudes toward learning and persj^ting in school. Even though these are the 
prime areas of emphasis for students, it was expected that FWS students wduld 
not fall behind in th^ir basic skills; i.el, FWS students would progress at the 
same rate as comparable students in*a traditiona^ school setting. FWS does 
provide an integrated program of basic skills training, although for the first 
semester of the year, the tutorial program within the Learning Ceriter had not 
yet been put in plage. , * ^ 



These five project goals were stated first in Hood,. Paul D. and Banathy/ Bela 
H., An Employer-Based Career Education Model; A Description and an. Operational 
Plan > FWL, January 31, 1972, page 85. . • . 

' '4 . : 
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In order to eval\iate the goals that have -been stated for the project de- 
scribed briefly above, a broad and^vaHed design for the evaluation was em- 
pl6yed. The Far Westf Laboratory EBCE- model is an innovative educational pro- 
grant , that is essentially individualistic and personal in -its -treatment of "each 
student, and thatv^is unconventional irt its"^'useN)T community resources, s^truc- 
turing of educational experiences, and management of student activities'. Assess 
ment of the outcomes of such a program calls fftr a mul ti-dimGnsional approach in 
volving a. variety of instruments, informants, and^flnalytic techniques in order 
to, get a comprehensive ,^cture of how the program works and what its effects 
are.' . , 

Data were collected from students, parents, resource volunteers, profes- 
sional intervi ewers ,^ and FWL-EBCE staff. Methods of data collection included 
external observations, written questionnaires, rating scales, interview sched- 
ules, performance- samples, aftd various forms and documents completed by stu- , 
derfts^BS part of their instructional program. A list of instruments employed 
appears in Appendix C./ Criteria by whicli this set of instruments was derived 
were: relevance to the 'stated goals, interest in obtaining common data across 
the four EBCE sites, and hypotheses* stemming from observed outcomes in. the pre- 
vious year. • ' . ' ^ i - 

' The.cQlle&tion and analysis of data used primarily fof making improvements 



in the »progriHlT were also varied,, and aV^explained in Chapters. Tbe use of 
evaluation tjiis year for model development and implementation was of major ir 
• portance -and was given concentrated-^ttention'"'(see Chapter 5 as well as ref/r- 
ences there to other program-development' evaluation documentation). 

For s^tudying-. student effe'cts, the design invplved coojparisons among^sev-' 
era! groups of students: 

•Group A: FW5 students returning from^the previous year 

' Group B: , FWS students entering in fall 1973 bu;t not part of the 
• randomly .selected experimental group' ^ 

k Group C: The experimental group of 'FWS students selected randomly 

from a-pool of applicants, entering in- fall 1973 

Group D: Control group students selected randomly from the same 

pool as Group C, but attent^ing various Oakland high schools. 

Group E:- A nepresentative sample of Oakland'Public School students 

Much effort was made in conforrrtance with Nl£ guidelines to construct and 
maintain the two^groups designated experimental and control, selected randomly 



from the ^applicant pool. The design includes pre-, mid- and post-tes+kng, 
.between-^group comparisons, and other traditional features, . • \ . 

, There are a variety of limitations inherent in an evaluation study of 
this kiJid, Many are intrinsic, to the nature of the program, others are due 
to the deficiencies in the current 'state 'Of instrumentation. Some short- 
comings may be inevitable in 'any internal evaluation effort^ especially those 
related to biasing effects and value judgments; care needs to be exercised so 
t;iat^he merits internal evaluation aV'e not outweighed by poten-tfal faults.' 
Flaws are clearly more -likely to oceu/" in outcome evaluation if it is done 
while a developing program is being stabilized. Other limitations result from^ 
legal, political, and social constraints imposed on a total program when it is 
being introduced in coof^eration with an existing school system, Sti^ other 
weaknesses result from the need to make priority choices when information is ' 
needed quickly for both program development and outcome *evalCi.ati on of a. 'total 
program, % * ' - 

In analyzing data, both descriptive and infcerential statistics were^em- 
ployed. Inferential use of statistics was restricted to pbmparisons between 
randomly selected groups from an operationally definable population. This 
-meant ^that the samples on which such inferences were based had to be small, so 
that the unknown errors may be quite l5irge,y 

Finally, a large proportion of the da^a presented Kere is based' on stu- 
dent se.lf-vreport and on rather "globall.^tated questions or answers, iWhere 
"P^sible,^ efforts have been made to./check" these responses against less sub- 
jective information. Nevertheless', much of the data may reflect halo effects, 
Hawthorne effects,, rater bias, and so on. Within the limits of time^and money, 
efforts have been inade to develop, and provide infopmation albout, instruments- 
less^subj»ct to thes^ kinds of bases; but frequent/y the only way to get infor- 
mation was to ask those involved what they thought or how they felt. Insofar 
as possible, we have tried to allow for these. biases. 

In summary the following activities were carried out in the evaluation 
effort: * • - , • - 

1. Instrument development./ Because .of the lack of available ih- 
strumentalltion for measuring EBCE program goals, considerable . 
effort went into the development of instruments. Nearly all 
measuring devices were .developed by the FWL-EfiCE staff, *br in 
collaboration with NIE /and.evaluators from the other three 
EBCE projects^ *Much effort was put into the scaling of items 
'in certain instruments. Reliability estimates were made and ^ 

2.0 ^ ^ « 
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relations among items^and among instruments were studied through . 

multivariate analysis methods. Results of these 'efforts can be • 

found in Chapter 3 and in the appendices. 
I ■ 

2. Identification and recruitment of student groups for companson. 

3. Collection. and analysis of data. 

4. Field testing of instructional components.. 

5. Pariticpatioh at joint planning meetings with NIE and EBCE projects. 

6. Initiation of a congruency analysis of objectives commdh to the ^ 
' four EBCE pr;)jects. 

7. Completion of a cost comparison study looking toward replication 
(sqe Appendix B for report of the study). 

8. Preparation of reports responsive to NIE requirements and special 
requests. ^ 

9. Furnishing data, and materials requested by a team conducting the' 
indjSpendent audit .of evaPluation procedures (see Appendix' A for 

\ audit report). ^ , ' ^ 

ORGANIZATION OF THt^ REPqRT ' ' ' — 

Chap-Per 2 of the report contains pertinent information about |^tutients. 
Recruitment ^and: selection are covered, and s^ubgroups within the FWS student 
bodyj control* groups , and comparison groups ^*are defined; included is a de- 
tailed description- of each of the groups in terms of baseline data collected. 
-*at the beginning of the school year. ^ 

In Chapters, Program Outcome Data, is contained the major evidence that 
has been collected, analyzed, and presented on program effects/" Most of the 
tables prepar'ed from interviW data are referenced and placed in Appendix C. 
Much information on the instrumentation appears in the appendices; descriptive 
material, instrument copie^and a critical review of some instruments are 
in Appendix C. Concluding th'e chapter on outcome data is a summary of the* 
major findings organized accorcjing to major goals of the program. 

■ Chapter 4^ Outcome Backup Research, contains four studies that are in- 
tended to provide what is felt td^be needed augmentation and perspective to ^ 
the limited range of information found in Chapter 3. Chapter 4 includes: 
(1) an anthropological study that focuses on day-to-day obseryfed tran^action.s, 
reactions, and cownuni cation patterns of students in the school and resource 



settings; (2) highlights of some interactions that appear to indicate inter- 
relationships amon^ program features; (3) test-taking.,attitudes Irpm. self- 
reports of students representing different comparison gcoups; and (4) a study 
to explore certain differences in educational philosophy among -organizational 
components of theVwL-EBCE project. ' / * * " ' 

Chapter 5, Model .Developjient and Implementation, contains descriptive 
information and evaluative daft on maoor model' features and procedures ob- 
served over the year. - The concentration is on procedures of diagnosis, ^ ' ■ 
orientation, and guidance'; ^learnin^ programs; student activity; learning 
packages; resource development artd maintenance; and'the interfaces of the 
model with the educational and economic setters of the Community, . 

A summary of the entire, report appears as Chapter^. 
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.CHAPTER 2: STUDENTS 



RECRUITMENT AND' SELECTION OF STUDENTS 
History 

During the first three semesters of this program's evolution, four re- \ 
cruitment efforts were undertak?^to attract students to Far West School. 
5e7era.l strategies were used iiinng^ these l^ampaigns: high school counselor 
referr^ils, student referrals, and media advertising, the campaigns were not 
aimed at recruiting.a large number of students—the 23 students seletted in 
the summer o'f 1973.^re the largest number to be selected at one tilne. Table 
2'.T ^provides recruitment data on FWS. : 



/ 





TABLE 2.1 

• SUMMARY OF fAST FWS RECRUITMENT. , 




.School ■ 
Semester 


Recruitment Method " . 


\No. of 
Applicants 


No. of New 
Students* 


- FaVl 1972 

SRrfrS^igya. 

Fall 1973 - I ■ 
* Y 

. Fall 1973' - II 
TOTAL HISTORY 

• 


Presentation at Oakland high schopls; 
higH ^school* counselor referrals 

i' 

Media campaign and student referrals 

Media campaign and student referrals 

Media campaign ajpid student referrals 

Counselor and student referrals and 
media campaigns 


82 

54 ' 
75 

60 ^ 
271 


j/15' 
17 

,23 \ ' J 
23 

78 . 



* this represents students actually enrolled; the number selected is'usucslly 
slightly higher. * t 
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Recruitment anS Selection for Fall 1972 



K In September 1972, a recruitment program* through the Oakland Public 
Schools produced 82 applic^s; of th^e students, 15 were selected for fall 
,1972 admission, EBCE staff were especially concerned with having students " 

V 

who would be accepted by employers for on-site learning, fearing jthat initial 
failures could irreparably harm Tong-term chances of success.* The applicants 
for fall 1972 enrollment therefore were screened in order to eliminate stu- 
dents with severe disabilities in communication skills, rtiotivattpn, or ini- 
tiative. 

^ Students were selected through interviews and writing samples as hfaving 
"adequate" skills in oral and written communications, as well -^as. "adequate" 
motivation and initiative. Selection was based on the pooled judgments of 
two staff members who had worked directly with 12 "representative" students 
hired as hourly-wage employees dunlng the summer of '1972, The sumftier "pre- 
pilot" project prepared resources and curriculum for the coming school year 
and exposed FWS staff to the kinds of problems tVey \^DuTd face with full-time 

.students in the fall. * 

. • * • ^ \ 

Recruitment and Selection for Spring 1973 

\. ' • 

For the spring 1973 semester, additional students were recruited through 
^ the public med\)a and personal referrals of enrolled students/ From th.is ef- 
fort^ 54 student^ applied and 17 were selected for enrollment. Again, as in 

^ ' TABLE 2.2 " ' 

GRADE LEV^L AND SEX OF FWS STUDENTS, 
■ ■ • SPRING SEMESTER 1973 



^ Grade> Level 


Male' 


Fema!l e 


^ 


1 


1 . 


11 




7 


-J 2 


8 


3 


Total • 


19 


^ 11 




10 ^, 





the ^all, selection was made on the basis of interviews and writing samples; - 
The '13 students continuing 'from 'the first semester bn^ght the total enroll/ ' 
'ment to 30 for spring 1973. Early recruitment had favbrfed mature students; 
^nly two sophomore students haci been admitted. The majority of applicants to 
the -program had been males, and such a majority continued Jo exist'in the 
spring student body. Table 2.2 presents the distribution of students by 

grade level and sex. . 

■' ■ » ' ■" • • 

Recruitment and Selection During Spring 1973 

;: 

Rpcruitment for|^ll 1973 was conducted in two separate efforts. The 
recruitment of students started in March 1973. -As in the previous fall, the 
/taff wanted- to balance the student population being enrolled for the next 
semester. Since a majority of the students expected to return were.m^le, and 
since most of "those would-be seniors, an emphasis 'Was placed on recruiting 
qualified younger students, especially females. Though the EBCE model' was 
still in its early development phase, staff felt a need to screen prospec^ve 
students to"*generate diveVsity and to avoid those who might overtax existing 
'resources because of I ing fa i 1 ure-pr6nfr oi*- likely .to cause disruption. The 
campaign had dual foci; (1) referrals" by , current students, and (2/public 
comnuni cations and media. Fw's vStudents were encouraged to" invitfe their 
friends to school information sessions. Radio and TV spots^re placed and 
posters set up in public buildings. Most applications calme from stud^)»*«^- 
ferrals. This effort was truncated in May 1973, upon receipt' of NIE guidelines ■ 
for a more rigorous evaluation design for 1973-74. Seventy-five applications had 
been received during the two months' effort and 26 students had aTlf^dy been 
notified of, selection before th'e- curtailment. The criteria for selection of 
these 26 were two: (1) strong learning motivation, and (2) noticejJSle personal 
initiative (i.e., the ability to organize and direct one's activities). These 
two qualities' were deemed essential for students in the individualized, 
experience-based program— especially during the current, formative phase. 

Recruitment and Selection During Sumner 1973 

In its guidelines for evaluation design for the "1973-74 year, NIE estab- 
lished the requirement for an experimental group of new students "with a 
matching control group, both randomly selected from program applicants: 
After study of these guidelines," Far West Laboratory developed a methodology 
for "selection of students a«d control group members (see Internal Summative 
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Evaluation Plan FY 74 ) and initiated a seTcond recruitfnent effort fpr the fall* 
This campaign began in June 1973, and continued through August/ The primary 
vehicle for this campaign was the public communications media, s»ince regular 
school was qot in session and student referrals, had been taken in th6 spring, 
Unselected applic^ints remaining from the earlier campaign were recontacted and 
queried about their current interest, and in this manner 15 student referra^^ls 
were brought back into the pool of prospective students • Sixty new applica?^* 
tions were obtained duripg the summer, , ^ 

Thirty -nine '.of the 60 "applicants were judged eligible for the program 
after checking grade level, place of residence, and age. An applicant pool 
of 54 was formed by the combination of the 15 spring "standby^" with the 39 
eligible applicants gathered during the summer. These applicants were con- 
tacted and asked to complete the Career Maturity Inventory and the Personal^ 
Orientation Inventory (total time: three hours) • '^are was taken to explain 
that these tests had an important role in the evaluation of EBCE!but that they 
would not be used for any decisions in the selection process. Forty-one of 
the applicants completed these assessments and were designated as the group 
from which' selection into e)^per^' mental and control groups would be made. 

The pla^ for random selection of experimental and control groups (ijl- \^ 
ternal Summailve Evaluation Plan FY74 , p. 25) required 52 applicants for . 
the stratifiefd random process; this number 'was not attained,. Though the 
sunmative evaltiation plan called for stratification on three' >/ariables (high 
school', grade, and sexj before random selection, it was 'decided to stratify 
the sample on two variables only (high school and grade) because further - . 
stratification would have resulted in several empty cells in the schema and 
many cases of noncomparability between experimental and control groups. 

Table 2.3 presents the strati ficatidn diagram and quotas obtained for 
each cell from data bn the distribution of Oakland public high school stu- 
dents. It also presents -the profile of the applicant pool when separated into 
the same cells. In Table 2«3 certain cells have an excess of applicants when 
compared with the OPS distribution; others have a deficiency of applicants. 
, In other words, the group of applicants was not completely representative of 
ethnic groupings of the OPS. Contingencies for such occurrences had been 
developed in the aqtual random selection proc^ure, which produced 
experimental and control groups of 19 membe^^s each with the remaining three 
students designated as "excess,,'* (One additional student was admitted for 



TABLE 2.3 

COMPARISON OF QUOTAS FOR EXPERIMENTAL 
AND CONTROL GROUPS WITH THE^ APPLICANT POOL 



High Schools 



Grade.. 


. • More Than 60% ' 
Black Students. 


Les« Than 60% 
Black Students 


Total 


Selection 
Quota 


Number of 
Applicants 


Selection 
Quota 


• 

Number of 
Applicants 


Selection 
Quota 


Number of 
Appl ic^nts 


.10 
11 

; 12 


8 

' ^6 
6 ■> ' 


6 
5 
8 


8 
8 
6 


9 
8 


16 
12 


15 

13 
03 


total' 


20 


, 19' , 


22 


^ 22 


42 


41 



special reasons.) These three "exces^" students were accepted into' the pro- 
gram ar»d tagged as potential replacement^ i^r the e;$perimeht4l group should any- 
drop in enrollment occur. 

The two recruitments resulted in "the selection of 49 new students for tlie 
fall semester. Forty-six of thgse students enrolled, bringing the total enroll 
ment in the fall" to 61 . 

Attrition During the Fall 1973 Semester 

• Attrition during the fall semester reduced enrollment from 61 to 55. The 
six students who left-EWS during the semester included three who left to re- 
turn to regular school during the orientation period ending October 5, one who 
returned to his high school in mid-October, one who moved to another city in 
November, and one who decided to seek full-time employment and left school in 
January 1974. The three students who left during orientation expressed a 
preference for their regular school. The student who left a few days after ' 
orientation stated that the possibility that letter grades would not be 
awarded jeopardiz^djiis eligibility' for continued financial aid through the 
Veterans' Administration; later information he furnished in January 1974 cited 
another- reason for returning to his regular Ij^h school: "an incident with 
another student concerning drugs." The decisions to leave FWS made by the 
other two students were related to family problems. 

13 « R 



Attrition During the Spring 1974 Semester 

Three students graduated from Far West Schaol at the conclusion of the 
fall semester.* One 'previous 'stude'nt returned to FWS to complete her high- 
school, diploma (she had passed the GED and attended a coimiunity college for 

* % * \ . " 

one semester; she returned on advice from her college counselor). Thus, 
enrollment at the beginning of the spring semester was^ 53, .Fpur students ' • 
left Far West School during the spring. One of these was' sent back to his 
previous high school early In the semester for continued lack of program ac- 
tivity. One student dropped during the first week to travel in Europe. One . 
studemj: suffered two serious automobile accidents- during the spring and spent 
most of the. semester in the hospital . . One njarried girl transferred to the 

"OPS Adult Education (evening) Program, At the conclusion of the spring se- 
♦ ^ •» 

mester, enrollment was 49. . ' ^ 

Summary and AnfUysis of.Past Recruitment anvl Selection 

The past efforts at recruiting students into FWS. provided information 
that, , when analyzed, should guide the program toward more effective and. effi- 
cient future recruitment. Two pnmany questions that should.be answered are: ^ 

# It 

1. How effective has FWS been at enrolling a population representative 
of Oakland high school students? ^ 

2, Whati;has been the relative cost-effectiyeness of various- advertising/ / 
recruiting strategies? * . ' 

The first question can be perceived in another light: How effective has 
FWS been in attracting minority group students? Table ^4 presents, the dis- 
tribution of entering students by ethn>c grx)up for each semester. ^According 
to the "Report on School, Region, and District Racial Ethnic Composition of 
Schools,"* the percentage composition of Oakland high schools is: Asian 
American— Black--63%, Chicano— 8X, White--22%* 

It is apparent that FWS has not attracted a proportional number of black 

students. There are several reasons that can be offered for this discrepancy: 

'"\ 

\' 1. The program was relatively unknown in the/Dakland black coninlunity 
until the sunomer of 1973. / ' . 

2. The .program had a temporal image, that is, a somewhat uncertain 
funding future that accentuated the risk accompanying entry into 
experimental programs. . 



Oakland Public Schools, October 1972, 
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TABLE 2.4 

ETHNIC DISTRIBUTION OF NEW STUDENTS 'BY SEMESTER , 



.School 


Asian 


Black 


Chicano 


White 


Total • 


Seifiester 


N 


% 


, N" 


% 


N 


% 


N 

* 


% 


N 


% 


Fall 1972 


2 


i 


3 


1 


■ .--7 


4 


27 


8 


53 


15 

< 

17 


100 


"spr.ing 1973 


0 




0 


6. 


3S 


4 


24 


7 


41 


■ 100 


Fall -1973 - I 


0 




0 


7' 


30 


3 


13 


13 


57 


23 


100. 


Fall 1973 - II 


0 




0^ 


11 


. 48 


3 


13' 


9 


39 


23 


• 100 


Total History 


2 


3 


25 


32 


14 " 


18 


37 • 


47 


78 


100 
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/a. McClymonds High School, a'nearly all-bUck public high scHool in 
• west Oakland, has a strong career-education program -of its own 
(Career Cluster Program). Almost no students from that high school 
apply, to FWS:. ^ ^ 

Acceptance pf an experimental educational program by the middle-class 
black community is not immediate; it must be earned by the demonstration of 
value and stability over a period of time. There is a reluctance among middle- 
class black- families to allow their children to enter an experimental program. 
Enrollm^t. in such a program presents some attendant risk to the continuity of 
the students' education, and this risk is often viewed as unacceptable. To 
black rpembers at lower economic levels^ experimental programs are commoaly 
viewed as ways t;^ use their children as "research subjects." 

The existence of the Career Cluster Program at McClymonds High 5chool and 
otfier innovative programs within the OPS. system makes it unlikely that FWS • 
will obtain precisely the proportion of minority applicants representative of 
enrollment in.OPS. Asian American representation is low, whereas Chicano en- 
rollment in FWS has always been above the representative proportion. The 
total minority enrol finent at FWS in February 1974 was 27 of 55. 

It is clear that future recruitment must be designed to att,>l^t a pro- 
portional v number of students among various ethnic groups. 

\ 



To determine the effectiveness of differing recruitment strategies, the 
application forms for 196 students judged eligible* for FWS (whether enrolled 
or not) were processed to determine the sqiwrces of information abaut EBC£ they 
lifted. The question to be answered was; "Which of the recruitment proce- 
dures were reported by students to have caused them to apply?" " Table 2.5 * 
presents a summary of sources of information listed by stwdents. 

TABLE 2.5 j 

STUDENT-REPORTED SOURCES OF INFORMATION 
. ' LEADING TO AN APPLICATION FOR ENROLLMENT AT FWS 



Year " 


No. 


Scho.ol* 


Poster 

« 


Newspaper 


Friend 


Radio 


TV • 


N 


% 


N 


% 


N 


% 




% 


n' 


Of 
A) 


N '. 


,% 


1972. 


71 


20 


28 


6 


8 


9 . 


13 


31 


44 


5 


7 


0 


.0 


1973 


125 


20 


16 


22' 


18 


5 


4 


.41 


33 


25 


20 


12 


9 


Both 


T96 


40 


20 


28 


14 


14 


7 


72 


38 


30 


15 


12 


6 



* School counselors: were mentioned by five studentship 1972 and by two in 1973. 



Table 2.5 shows that word-of-mouth is very much the chief means of re- 
cruitment reported. If it is true that the "School" source is by word-of-mouth, 
as welU the overwhelming, percentage of students-(58%) heard about FWS in this 
manner. Kone of the 1972 respondents reported both "School" and "Friend", as 
sources, and only three did so in 1973, indicating that we may be counting the 
same students twice in only Z% of the 196 cases. (The assumption behind this^ 
fcount of responses was that if the "Friend" told him about FWS while sit school, 
the applicant might report both as sources.) As the major 1973 l^ecrgitment ac- 
tivities utilizing media took place while schools were closed for sumiDer., analy- 
sis of the frequency and coverage provided by newspaper, radio, and TV will 

' ^''^ / . 

A'total of 271 -applications had been received, but only T96 met administrative 
criteria for S^7gibility. 
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determine which was most prbducti.ve.^ The number and location of posters, and 
the number of radio announcements, JV'sliowings, and newspaper articles are de- 
scribeijn Table 2.6 - • ^ 

TABLE 2.6 
1973 RECRUITMENT ACTIVITIES 



0 

1 


Posters 


Radio Spots 


TV Spots " 


Newspaper * 

— w 


Number/Frequency 


200 posters 
in buses and 
small stores 


3 stations; 
10 announce- 
ments daily 


1 station; 
1 or 2 daily 


1 feature 
article in 
Teens. sect ion 


Time Period 


August 


May- June 
July-August 


June- August 


July 



fable 2.7 shows the effect of having a student body to help "sell" the 
school The increase in people's knowledge of FWS may also reflect^t+ie effect 
of mediH and poster use. 



TABLE 2.7 

t 

CATEGORIES OF "FRIENDS" REPORTED ON APPLICATIONS 
- . FOR ENROLLMENT IN 1972 AND 1973 



Friend Specified as: 


1972 


1973 


1,^ 

Both 


N 


% 


N 


% 


■ N 


% 


1. -Student, former student, or other 
Fy/S applicant 


15 


1 

48 


24 ' 


58 


39 


55 


2. Relatives: grandmother, mother, 
sister, brother, uncle . 


4 


13 


4 


-10 


8 


11 


3. Name of purson not known to FWS 


1 


3 


5 


12 


'6 


8 


4. Not specified 


11 


36 


'8 


20 


' 19 


26 
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To summarize, ^the majority of prospective students reported that they 
"heard about FWS from friends.. Radio announcements were the prime emphasis of 
the 1973 recruitment, running daily on three stations for four months; they 
proved only somewhat fruitful (25 eligibles). The poster campaign was imple-" 
mented in August and provided many late applicants (22 eligibles). The.tele- 
,vision filler; spots and newspaper feature article showed poor results. (12 and 
15 eTigibles respectively). 

The total- cost figures for the recruitment campaign are revealing: 
Method ' ■ » Cost 

Posters • • . ' $785 

Radio Spots , $3914 
Television pj^ee 
Newspaper . . Free . ■ 

Friends *. * Free 

When .one compares the cost figur^^^each method with the eligible stu- 
dents each method generated, the following cost figures result: 

Source f^^ ' Cost Per Eligible Applicant " 

Television, newspaper, friends 0 
Posters . . $36 

' Radio * - $157 

It is clear that the radio campaign was the least cost-effective. The tele- 
vision spots were free; The" 'initial newspaper article was free, but may not 
be repeatable. The poster campaign last year was costly but drew many appli- 
oants, considering .the relatively short period of use. The cost would be 
.similar for an extended period. 

Study of the past figures indicated that "the potential number of eligible 
applicants' reachable through these media is too small to provide an adequate 
number of students- for next year. The recruibjient campaign for 1974-75 was 
undert.aken in the^^prin^— before "sunimer recessi-and direct contact with' Oakland 
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.high schools was accomplished'. That effort is considered a portion of the 
1974-75 EBCE activity and thus will be^described in the evaluation report for 
next year. * ^ ^ - 

CURRENT FWS STUDENTS 

For. the study of treatment outcomes, the students at FWS can be separated 
into distinct groups aecording to their time of entry and method of selection: 

Group A— returning students from 1972-73 
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Group B— students entering in fall 1973, selected in spring 1973 

Group C--students entering in fal.1 1973, selected in summer 1973 

Group 0— students entering in fall 1973^ representing unusual ad-' 
mini strati ve cases. \ * <K \y 



These student grou|^exis# for the purpose of analysis only; no such re^l ^ 
classification was made, and the treatment applied was not dependent on these 
groupings. Nevertheless, each student group labeled A, B, and C represents a ; 
disjoint. set of students with common ^characteristics (desci*tptors) defined by 
their entry. 'So it is possible to Jiypothesize differing program outcomes a- 
mong these sets. The situation, or set of parameters, descrij^ing the entry 
of each group is presented below. Later in th'is chapter the student groups 
are compared with each other and with the total FWS population' (often called' 
Group W for the "whole") and with pertinent groups of Oakland high school stu- 
dents'on several important demogVaphic variables. 

Returning Students: Group A J 

All students enrolled in the 1972-73 pilot EBCE program at FWS were en- 
couraged to re-enroll in fall 1973. Fifteen of 20 nbngraiiuates* did enrolls 
in September.* 'Within the first two we^ks of school, one of them withdrew, 
leaving 14 continuing students from the previous- year. Three of these students 
graduated at midyear. This group provided, to the arriving newcomers the es- 
sential school element of "upperclassmen" or "veterans." ^ince they ^previously 
had at leastM)rie full semester of familiarity wfth the concept of experience- 



*Questionnafires to identify the reasons for npt confipuing were sent to the 
five- students who did not^ enroll, but none were returned.. ^ 
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based career ejlucatipn, this group currently represents the outcome of three 
or more semesters of EBCE.* . ^ 

' New Students Selected During Spring 1973: Group B ' ^ 

Recruitment for fall 1973 began during M^jxh^and ended in May 1973, on 
receipt of NIE guidelines requiring the establishment of experimental and 
control groups for the 1973-74 year* The two months' effort resulted in se- 
lection of 26 applicantsMor the fall prt^gram. On the basis of an application 
form and a personal interview, each of these students was judged "especial'ly 
well suited" for the^EBCE program. 

In selection, the staff attempted to balance the student population by 
choosing more females and younger students to offset the anticipated -composi- 
tion of the returning students (mpstly male seniors). Of the 26 students 
chpsen, 23 enrolled at FWS in Septen\ber 1973. , Three students withdrev; during 
the fall semester. The remaining 20, comprising Group B, represent .an effort 
at choosing stui^nts who might benefit mostiffrom EBCE. 

New Students Selected During Summer 1973; igroup C 

Upon receipt of NIE guidelines establishing the 1973 experimental design, 
the spring recruitment campaign was temporarily postponed. Applicants were 
notified that a decision on their states would be made in the summer. A new 
recruitment effort, implemented in June, continued throughout the summer. Ap- 
plicants (both' those remaining from spring' and those applying during summer) 
were placed in a selection pool, stratified on high school of previous attend- 
ance and on grade level; they were then randomly selected into equivalent ex- 
perimental and control groups. Each group chosen contained 19 members. During 
the fall semester two students withdrew. Three ^additional students withdrew 
during the spring, leaving 14 members ht the close cff the year. Group C repre- 
sents ;a cross-section of prbgraift applicants for fall 1973; often described in 
this report as the experimental groupr, it; H^s a corresponding Acontrol group 
(Group D, described below). ^ ' . / 



In fact, nine of these 14 had two semesters of EBCE by fall 1972; five had 
^only one. However, since the*model was still in early development during its 
fall. 1972 semester, and largely took its current form during spring 1973, it 
was/decided not to distinguish further ahiong these students. 
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other New Students: ' Group 0 ^ < ^ 

^ Four students entering FWS in the fall of 1973 do not fall into any of 
the classes above. They represent1|pnique cases faced By FWS during recruitment 
and selection. One of these students returned to' his original^flf^ school 
during the spring, Studenfs assigned to Group 0 are reported in analyses of ^; 
the entire group, of FWS students but not in any of th'^e special analyses of 
Groups A, B, -or C. . ' • 

; F 

OAKLAND PUBLIC HIGH SCHOOL STUDENTS SERVING IN CONTROL AND COMPARISON GROUI^S 

Two different groups of Oakland high school students are' cooperating with 
FWL-EBCE in the evaluation.. One o,f the two groups serves as a controV group 
for FWS Group C (random-experimental). The other group serves as a comparison 
group fonjthe total FWS population. The two groups are: 

^Group D--applicant-s to FWS from Oakland public high school^ eligible 
for FWS but randomly selected for" the Control G^oup fo^ FWS 
» Experimental Group (OPS Control Group).. 

Group E--stUdents (nonapplicants) in Oakland public high' schools 
randomly selected^and representative of the total high^-^ 
^ school population (OPS Comparison Group h 

Groups D and E, as expected, have fewer cooperating meiiibers Uhan were • 
originally selected. One of the questions addressed in the follo\ying. dis- 
cussion of Groups D and E is:. "How representative of the .respective randomly 
selected samples are the reduced samples^f cooperating students?" . 

FWS Applicants Selected Randomly for a Control Gnoup: Group D 

t 

Nineteen applicants were selected for the Control Group D, Main- 
taining the cooperation of this group--in an effort consisting mainly of an-, 
swering questionnaires and completing tests—was indeed a problem. Members of 
Group D were nHi£ied of their status by telephongjand special attention'was 
given to-their retentidh* ^ All were asked to conie to a special presentation ^ 
describing EBCE, the experimental nature of-the school, and the need for 
control -group members. - The studervts-were informed of their anticipated con- 
^tributions, including several s(^sions throughout the year of one or two houb 
each, for which they would receive honoraria. They were^romised a counseling/ 
interpretation sission after the end of the school year in which their assess- 
ment profiles would be presented and interpreted. A further possibility $ug- 
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gested was that they would be awarded priority status as applicants for subse- 
quent FWS admission* Fourteen. of the 19-students cooperated in each ot the 
first two summative testing sessions: October 1973 and January 1974*^ Twelve . 
of the students participated in the year-end '(May 1974) testing session* 
Table 2*8 presents a comparison of the. Group D sample as originally selected^ 
iind the subsets of Group D-who have participated in the summative testing ses/- 
sions. . • • 



TABLE 2*8 * • 

COMPARISON OF THE ORIGINAL AND 
PARTICIPATING COMPOSITIONS OF THE CONTROL GROUP 



History 


Grade \evel . 


Previous 
H.S.* ■ 


Ethnic Group 


. Sex 


lO 


11 


12 


I 




White 


Black 


Other 


M 


F 


Original Size 


7 


6 


6 


8 


11 


8 


9 


2 


6 


13 


First Session 


3 


6 


5 - 


5 


9 


. 6 


■ 6 


■ <2 


6 


8 


Second Session. 

Third Session, 
• 


3 
3 


6 
5 


5 
4 


5 
4 


* 9^ 
8 


6 
5 


'6 


2 
.1 


•6 . 

5 » 


8 
7 



* I = more than 60?J^ non-white students; II = fewer .than 60% non-white. 



As is showrjj^ the table, all but one whoVopped from the Control- Group 
were women; fourV seven were sophomores. The Chi-square test.applie^J to the 
groups of year-en(Wpartici pants and nonparticipants shows no significant dif- 
ferences at the .05 level, but this test is .of doubtful accuracy with such 
small frequencies. The extent to which generalizations can be made from com- 
parisons between Group C and D.is quite uncertain. 

Randomly Selected Sample of Oakland Public' Hi gh School S tucients: Group E 

In November 1973, FWL-EBCE selected a stratified random sample of 120 
students from the rosters of the Oakland public high schooTs. Approximately 
20% of the students selected Vrom fall registration records were no^^^nger 
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enrolled in November and .addresses could be located for only 96 members of 
the sample. These students were- contacted by mail and asked to serve" as a 
group of comparison students for the,£BCE sample. They were offered a small 
Mmuneration for each of several testing sessions proposed for the merim 
art^'jDost data-collection efforts. Thirty-one students appeared for tne in- 
ier^im data-collection session, held on Saturday, January 26, 1974. Twenty- 
four students attended th.e post data-collection sessions on May 18,,-' 1974. 
Demographic data have been collected pn both the participating and nonparti- 
cipating members of Group These are presented in Table 2.9 along with 

.. • ■ - )■ . 

TABLE 2.9 / , 



1 



COMPARISON OF ORIGINAL AND 
'participating compositions of the ops COMPARISON GROUP 







Midyear 


End of Year . 


Variably 


Category 


Show 


No- 
Show 


Chi -Square 
Test (p=.05) 


^ow 


No- 
Show 


Chi-Square» 
Test (p=.05) 


Sex 


Male/ 
Female 


16 
15 


44 • 
38 


Not 
Significant 


11 

n 


49 
42 


Not 
Significant 
it 




Ca's.tlemont 


8 , 


. 17 




. 7 


18 


« 




Fremont • ' 


5 


13 


< 


3 


15 




* 

High School 


. Oakland High 
Oakland Tech 


5 
4 


18 

10, 


Not 
Significant 


2 

* 

2 


12 


Not 
Significant 




Skyline . 


7 


16- 




7 


16> 






McClymonds 


'2 


8 


1. 




9 




- ( 

Grade Level 


10 


•10 


35 






37 




11 


15 

1 


.19 


Not 
Significant 


12 


22 


Significant 

, 1 




12 


6 


28 




2 


32 



Wa could be located on^nly 82 of 89 nonpartici pants 
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the results of the Chi-square test for significance of di fferfence between the 
two subgroups. Grade-point averages were also corppared for the two- sets df ' 
students* These cpmparisons revealed the following: - - ) ' 

° Mean grade-point average of the midyear partjjflpating members of ^ 
, Group E was 2.12** 



° Mean grade-point average of midyear no-s}iov5s of Group E was 2.31. 
° the difference was not significant at the .10 level.- ' ' ^ ^ 

On the ba^is of these results, the parti fci£ating members of the stratified, ' 
randomly s^rlected sample of OPS students cwrelis^d as representative of Oakland^ 
high school students in the remainder of this report. Qualifications will be 
made to recognize the -biased attrition rate with respect to grade level i,n the 
OPS Comparison Groupv ^ 

COMPARISONS OF STUDENT GROUPS ON DEMOGRAPHIC VARIABLES * ' ^ 

Given the rationale for and the description of the various subgroups of 
EBCE students within FWS and the control /comparison groups within OPS, several 
intergroup comparisons are essential tcJ'the evaluation of treatipent (EBCE) 
outcomes* In order to infer thfiLXa^ise of any differing outcomes among these 
groups, the groups first must be analyzed for sample similarities and dif- ^ 
ferences. 

Comparisons of -different FWS groupsfon demographic baseline data will 
build the foundation for later interpretation of any differing outcomes found 
among these groups. Comparisons of student groups within FWS with corresponding 
groups within OPS on baseline variables will /reveal the degrees of similarity - 
and difference between these groups, and thui will define the limits to which 
statistical inference can be used in evaluating the effect of the EBCE pro- 
gram, on .high school students. Table 2.10 presents the baseline demographic 
data cblleeted at midyear on the FWS and OPS student groups. Table 2.11 pre- 
seats the group means and standard deviations for age, grade level, and grade- 
point average. ' . r 



*A=4, B=3, C=2, D=f, F=Q./ , 



TABLE 2.10 ' . . 

BASELINE (2/74) DATA ON STUDENT DEMOGRAPftlC VARIABLES BY GROUP'' 



Far West School 



W=55 



A=14 



Bt20 



C=17 



Oakland 
High Schools 



D=14 



E=31 



Variable 



High School. 



Current 
Grade level 



Sex 



Values 



N 



High -Minority 
Low-Minori^ty 



21 
34 



10 
11 
12 



15 
14 
2§ 



Male 
Female 



26 
29 



38 



V 

47 



0 
2 

12 



47 
53 



% 



N 



36 
64 



4 
16 



0 

14 
86 



64 
36 



6 

14 



N. 



20 
80 



45 
25 
30 



30 
70 



8 

9- 



% 



47 

si 



35 
41 
24 



47 
53 



•N 



36 
64 



15 

16 



21 
43 
36 



10 
15 
6 



43 
57 



16 
15 



Ethnic Group 



Black 
Chicane 
White . 
Other 
No Answer 



15 
9 

29 
2 



27 
16 
53 
4 



7 

29 
50 
14 



5 
2 

13 
0 



25 
10 
65 
0 



41 

■ 6 
53 
0 



43 
7 

43 
7 



20 
0 

10 
1 



Age (9/73) 



15 pr Under 
15+ to 151$ 
15%f to 16 
16+ to'16% 
165s+ to 17 
17+ to. 17»s 
17Js+ to 18 
Over 18 



4 

5 
8 
7 
7 

16 
8 
0 



7 
9 

15 
13 
13 
29 
15 
0 



0 
0 
7 
7 

21 
43 
21 
0 



15 
10 
25 
20 
0 

25 
5 
0 



6 

18 
12 
12 
18 
18 
18 
0 



21 
0 
7 

29 
14 
21 
7 
0 



Regular 

School 

Curriculum 



Academic 
General 
Vocational 
Other 



22 
28 
4 
1 



40 
51 
7 
2 



57 
36 

si 



6 
12 
2 
0 



30 
60 
10 



7 

'9>| 
0 
1 



4r 

53 
0 
6 



43 
50 
. 7 
0 



*As noted in the text, there was 
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further attrition in thQse groups for final testing. 
25 

AO 



TABLE -2. 10 

BASELINE (2/74) -DATA ON STUDENT DEMOGRAPHIC VARIABLES BY GROUP* ' 

(Continued) 







Far West School 

/ 


'Oakland 
High Schools 


* 




W= 


55 


A= 


14 


•8=2 


/ 

Q 


C=17 


D= 


^14 


E= 


=31 


Variable 


Value 


N 


% 


N 


% 


N 


h 


N 


<v 
% 


N 


% 


N 


% 




None 


1 


L 




U 


°/ 


n 
U 


1 


6 


u 


n 
u 


0 

c 


7 


• 


Elementary 


u 


U 


U 


U 




U 


0 


0 


1 
1 


7 

• 


o 


in 




Some High School 


h 

,4 


7 


1 


7 


u 


n 
u 


2 


12 


9 

Cm 


14 


U 




Father's 


High School Graduate 
Some Post-High School, 


15 
14 


27 
26 


o 
L 

4 


14 

on 


Q 
O 

o 
0 


/in 
lb 


5 
5 


•29 
29 


o 
0 

c 


91 


19 
0 


in 


Level 


Colleae Graduate 


7 


13 


4 


29 




10 


0 


0 


A 


90 


o 


in 




Some Graduate Studv 


3 


6 


0 


0 


1 


5 


2 


12 


0 


'o 


.1 


3 




Advanced Dearee 


4 


7 


1- 


7 


2 


•10 


1 


6 


. 0 


0 


1 


3 




No Answer 


7 


13 


2 


14 


4 


20 


1 


■ 6 






u 


0 

u 




01 Unspecified Job- 


14 


26 


2 


14 


7 


. 35 


4 


24 


3 


21 


• 

10 


•32 




02 Business-Clerical 


2 


4 


0 


0 


1 


5 


t 


c 
D 


0 


. 0 


0 


. 0 




03 Business-Sales . 


0 


0 


0 


0 


0 


0 


U 


u 


■ 0 


0. 


-0 


0 




04 Business-Management 


2 


4 


1 


7 


^1 


5 


0 


-0 


1 


7 


6. 


0 




0& Crafts & Operative 


5 


9 


3 


21 


0 


■ .0 


2 


12 


0 


0 


0 


•0- 




06 Technical 


3 


6 


1 


7 


1 


5 


1 


6 


1 


7 


2 


7 • 




07 Services & Protection 


1 


4' 


1 


7 


0 


0 


0 


0 


2 


14 


■ 2 


7 


Long-Range 
Plans 


08 Professional 

09 Mllitarv 

10 Housewife^S^^ 


6 
-0 
0 


n 

0 
0 


1 
0 
0 


7 
0 
0 


2 
0 
0 


10 

# 

0 
0 


3 
0 
0 


18 
0 
0 


a 
1 

0 


0 
7 
0 


6 
2 
1 


19 
3 




ir Farmer 


0 


0 


0 


0 


0 


,0 


0 


0 


Q 


0 


0 


0 


• 


T2 Retired 


1 


.2 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




*• 

21 Higher Education 
(unspecified)* • 


5 


9 


2 


14 


0 


0 


3 


18 


2 


14 


_ 8 


26 




22 MA or PiiD Degree 


1 


2. 


1 


7 


0 


0 


0 


0 


1 


7 


0 


0 




30 Can't 5ay 


14 


26 


. 2 


14 


8 


40 


3 


18 


3 


21 


0 


0 



I I 

*As noted in the text./ttere was further attrition. in these groups for final testing. 



TABLE 2.10- - 

BASELINE (2/74) DATA ON STUDENT DEMOGRAPHIC VARfABLES BY GROUP 

(Continued) 



1^ 



Far West School 



Oakland 
High Schools 



■ / 




55 


A= 


14 


B= 


20 


C= 


17 


D=14 


, E=31 


— ■ 'V 

Variable 


Valine 


N 


% 


N 


% 


N 


% 


N 


% 


N 


to 


N 


id 




e 

3.50 - 4.00 (A) 




t; 


1 


7 


2 


10 


0 


0 


0 


0 


2 


6- 




2.50 - 3.49 (B) 


19 


35 


8 


57 


6 


30 


4 


24 


3 


21 


10 


32 


Previous 
Grade-Point . 
Average 


1.50 - 2.49 (C) 
0.50 -J. 49 (D) 


24 

7 
1 


44 
1? 


4 

1 


29 
7 


'a 

3 


40 
15 


10 
2 


59 
12 


6 

0 


43 

U 


15 


48 
in 


0.00 - 0.49 (F) 


, 1 


2 


0 


0 


* 1 


5 


0 


0 


1 


7 


0 


' 0 




Not Available' 


1 


2 


0 


0 


. 0 


0 


1 


6 


4 


29 


' 1 


3 




None 


1 


2 


0 


0 


1 


5 


0 


0 


0 


0 


1 


3 




Elementary 


0 


0 


' 0. 


0 


0 


0 


0 


0 


c 




1 


'X 
o 




Some High School 


7 


13 


1 


7 


3 


15 


2 


12 


3 


21 


6 


19 


Educational 


High School Graduate - 
Some Post-High School * 


'•I 6 
16 


29 
29 


3 
3 


,21 
21 


4 
5 


20 
25 


8 
6 


47 
35 


4 

3 


29 
21 


10 
3 


32 
10 


Level 


College Graduate 


1 u 


1 o 






A 

t 


?0 


1 

1 


"6 

1 


1 


7 


b 


lb 




Some Graduate Study 


' 5 


9 


2 


14 


3 


' 15 


0 


0 


1 


7 


4 


13 




Advanced Degree 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


" 3 




No Atiswer 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




Better, Nice, 
Get Education 


20 


36 


5 


36 


8 


40 


7 


41 










Summary of 
Reasons for 
Applying to 
FWS** 


Different, Change, 
Meets Personal Needs 

Dislil^e Previous School 


•40 
33 


73 
60 


9 

10 


64 
72 


14 
13 


70 
65 


16 
6 


?4- 
35 










(9/73 post- 
entry) 


Career Exploration 

Job Training, ■ 
Get Ready for Work 


21 
9 


38 
16 


7 
1 


50 
7 


8 
4 


40 
20 


5 
3 


29 
18 






1 






No Answer 


1 


2 


2 


14 


0 


0 


0 


0 








m " 



*As noted in the text, there, was further attrition in thes^ groups for, final testing. 

**Summary of Reasons for Applying to FWS includes first, second, and third reasons 

if students gave them. Primary Reason, shown on the next page, includes only the 
* (S^*"?* reason given. 27 



TABLE 2.10 

f» BASELINE iZm) DATA pN STUDENT DEMOGRAPHIC VARIABLES BY GROUP* 

(Continued)^ 







Far West SchooV 


Oakland 
High Schools 






w= 


55 


A=14 


B=2P 


C= 


17 


D= 


14 


E= 


31 


Kj/ariable 


Values 


"N 


% 




% 


N 




N 




N 


% 


N 


% 




Better, Nice, 
Get Education 


12 


22 


3 


21 


4 


20 


5 


29 










Primary 
Reason for 
Applying 
to FWS 

(9/73 post- 
entry) 


Different, Change, 
Meets Personal Needs 

Dislike Previous School 

Career Exploration 

Job Training, 

Get Ready for Work 


19 
13 

' 6 

4 


35 
24 
11 

7 


4 
5 
2 

0 


29 
36 
14 

0 


c 

6 
2 

3 


25 
30 
10 

15 


9 
1 

t 

2 
0 


53 
6 

12 
0 












No Answer 


1 


2 


0 


0 


0 


0 


0 


.0 











TABLE 2.11 . 

- \ MEANS AND STANDARD DEVIATIONS FOR 

AGE, GRADE LEVEL, AND GPA FOR STUDENT GROUPS 
(9/73) 



* Group 


Age (months) 


Grade Level 


GPA (A=4.d) 


^Mean 


SD 


N 


Mean 


SD 


N 


Mean 


^ sb 




W 


198.4 


10.69 


55 


1V32 


0.79 


55 


2.22 


0.82 




54 


A 


204.5 


6.84 


,14 


11.86 


0.35 


14 


2.50. 


0.81 




14 


OBC 


196.3 


10.96 


41 


10.98' 


0.84 


41 


2.12 


0.81 




40 


B 


193-.4 


10.43 


20 


10.85 


0.85 


20 


2.21 


0.94 




20 


C 


J97.2 


11.14 


17 


10.88 


0.76 


17 


2.09 


(J. 65 




16 


D 


195.9' 


11.30 


14 


11.14 


0.74 


14 


,2.16 


0.92 




10 


E • 


196.0 


11.20 


31 


10.87 . 


0.71 


31 


2.31 


0.80 




30 



*As noted in the text. , there was further attrition in these groups for final testmg 
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InteVgroup Comparison With-in Far West School 

C omparison of Returning Stud^^nts (Group A) with Lat(erJ!ecruits (Group- OBC) 

Returni/ig students (Group A) are' the products of a^ different recruitment 
program from the one used during 197-3, so Group A is quite likely to be dis- 
similar-'ivi composition from the remainder of FWS. These differences may- al so 
effect treatment outcomesV^ Furthermore, by definition Group A (returnees) 
precludes sophomores as members. 

The Chi-square test indigates differences significant (to at least the 
.10 level) between Group A and Group OBC "(newcomers to the program) on four 
variables: grade level, age, ethnic group, and previous grade-point average. 
The difference between the two groups on grade level is 'explained above. 
Group A a^lso-hasin higher mean and smaller standard deviation for students' 
age; this, too, ^'s directly attributable to the absence from this group of 
sophomores who are approximately one year younger. 

Group A (returnees) shows a marked -difference in ethnic composition trom 
the remainder of FWS. It has only one black student among its 14 members {!%) 
compared to 14 black students among the 41 members of Group OBC (34%). This 
fact was previously noted and discussed. FWS continues to disseminate infor- 
mation to the black community on the value and objectives of EBCE. 

The higher mean of Group A (returnees) on grade-point average before 
EBCE ento^is consistent with the complex recruitment history for that group. 
The earliest students at, FWS entered irt September 1972 included several problem 
referrals from high school counselors. When the number of students wa$ in- 
creased in spring 1973, screening of applicants eliminated very low achievers. 
Program attrition through both dropout and graduation has reduced these stu- 
dents from -the original 30 to 14, but the dropout rate has been higher among 



the problem student?. The group of continuing students (Group A) now ^ores 
the school mean on most 
see Table 2.11 for GPA. 



above the school mean on most measures of achievement we have administered, 



ERLC 



29 



Comparison of Spring Selection (Group B) with Summer Se^lect ion (Group C) 

There are no statistically significant differences between tjiese two 
groups of .new stydents across demographic variables (Table 2.10), However, 
note that 80% of Group B students who were selected on crite«a ,came from 
high schools with low-minority enrollment, whereas for Group C, the minority 
proportion of previous high school was used as a stratification Variable (as- 
signed a ratio of. 11:9, the applicant proportion). As a result, only Z5% of ' 
Group B are black, whereas 41% of Group C (r'andom FWS) are black. However, 
the black (representation of Group C is still well below the documented.62% 
black, enrollment of all Oakland high^schools .* Thf variation in high school 
representation and related ethnic di-6.tri butions among groups to- a large ex- 
tent results from differences in recruitment procedures, .These procedures 
were examined earlier'in this section whMjjriis cussing the evaluation of EBCE 
recruitment. * ^ ^ - . • 

Far West School Students by Grade Level 

Differing treatment outcomes can be hypothesized for EBCE students accord- 
ing to their grade level. Seniors may well have sufficiently greater maturity 
that they are more at ease in relationships with RPs and thus effect greater 
learning outcomes from EBCE, Midyear baseline da'ta on FWS students aggregated 
by grade level are presented in TabjjB^.12. 

Far West School Students by 




An important question to be ar^wrfred.in the evaluation of EBCE is whether 
or not the experience-based p^e5ram of career education [Jfovides equal learn- 
ing opportunities for both young men and young wpmen. This question is com- 
plex, its answer requires continual monitoring of student-resource interaction, 
types of learning experiences offered at sites, and willingness of RPs to work 
with the sexes. Consequently, careful analysis is necessary to detect any dif- 
ferences in outcomes between the sex groups. Demographic data comparing FWS 
males and 'females are shown in Table 2,T2. 



Representative Gr.oup E has 65% black membership. 
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TABLE 2.12 ' 
BASELINE (2/74) DATA ON FWS STUDENTS BY GRADE LEVEL AND SEX 











Grade level 


Sex 






Group W 


10 


n 


12 


Male : 


Female 






N= 


55 


N= 


15 


N= 


14 


N=26 


N= 


26- 


. N= 


=29^ 


Variable 


Value 


N 


% ' 


N 


% 


N 


' % 


N 




N 


t 


1 

N 




High ^School 


High-Minority 
Low-Mi nority'^ 


21 
34 


38 
62 


4 
11 


27 
•73 


5 
9 


36 
64 


1 C 




n 

15 


42"^ 
58 


JO 


34 
66 


Current 
6raae Level 


10 

11 ■ 

12 


•26 


CO 

47 


So 
U 

0 


lUU 

u 


U 
0 


U 

1 uu 


0 
0 
26 


0 
0 

< 

lOO 


c 
D 

c 
0 

14 


CO/ 
CO 

5^ 


H 

Q 
Q 

0 

12 


. CO 

41 _ 


Sex— ' 


Male 

Fema 1 p , 


26 
29 


47 
53 


6 
9 


40 
60 


6 
8 


43 
57 


14 


54 
46 


26' 
0 


100 
0 


0 

29 


0 
100 




Black ' 


15 


27 


5 


33 


2 


14 


8 


31 




31 


7 


24 


Ethnic Group 


Chicano i 
White 


9 

29 


16 
53 


0 

10 


0 
67 


2 
9 


14 
64 


7 

.10 


27 
39 


5 
11 


4/ 


* 4 
18 


14 

62 


X 


Other^ 


2 


4 


0 


0 


1 


7 


T 


4- 


'2 


8 


0 


0 




No Answer 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


.0 


0 




15 or Under 


"4 


7 


4 


27 


0 


0 


0 


0* 


0 


0 


4 


14 


« 


15+ to\l5is 


5 


9 


5 


33 


0 


0 


0 


0, 


2 


8 


3 


10 




15%<- to 16 


1 

8 


15 


5 


33 


2 


14 


1 


4 


3 


12 


5 


17 


Age (9/73) 


10+ to lo*5 
16%+ to 17 


7 
7 


13 
13 


1 
0 


7 
0 


6 
4 


43 
29 


.0 
3 


0 
12 


.4 
4 


15 
15 


3 
3 


10 
10 




17+ to 17% 


16 


29 


0 


0 


1 


7 


15 


58 






9 


31 




t o 18 


8 


15 


0 


0 


1 


7 


7 


27 


• 6 


1 


2 


-7 




Over 18 , 


0 


0 


0 


0 


0 


oj 


0 


0 






0 


•0 




Academfc 


22 


40 


3 


20 


5 


36 


14 


54 


if 


58 


7 


24 


Regular 

*Schqol 

Curriculum 


General 
Vocational 


28 
4 


7 


10 
2 


67 
13 


9 
0 


64 
0 


9 
2 


35 

- 8 


9 
2 


35 
8 


19 
2 


66 
7 




Other 


0 


q 


0 


0 


'o 


0 


0 


0 


0 


0 


0 


0 
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" BASELINE .(2/74) DATA ON FWS STUDENTS BY GRADE LEVEL AND SEX 
. (Continued) 



• 








Grade ^bev^l 


* 

Sex 






Group W 


• 10 ■ 


11 


12 


Male 


Female \ 






N= 


55 


N=='15 


N=^4 


N=26 


N= 


=26 


N=29 


Via! laUlw 


Value 


n 


a 
To 


N 


% 


N 


% 


N 


% 


IN 


h 


n 


% 




None ^ 


1 


2 


0 


0 


f 


7 


0 


0 


0 


0 


1 


3 


• 


PI AmAn'ha * 
c 1 ciiicii ua 1 jr 


0 


0 


0 


0 


0 


'0 


.0 


0 


'0 


' 0 


0 


0^ 




Somp'Hlah School • 


/ 7 


13 


1 


7 


3 


21 


3 


12 


4- 


15^ 


.3 


10 


Mother's 


Hi oh School Grad£tate 


16 


29 


6 


40 


5 


36 


5 


13 


10 


3^ 


'6 


'21 


Educational 


Some Post-High School 


16 


■ 29 


3 


20 


2 


14 


.11 


42 


8 


31 


8 


28 


Level 


Pnllpnp RrAHNf)i*-p 


10 


18 


4 


27 


1 


7 


5 


19 


3 


12 


7 


24 




Some Graduate Studv 


5 


'9 


1 


7 


2 


14 


2 


8 


1 


4 


4 


•14 




Advanced Deoree 


U 


U 


0 


0 


0 


0 


0 


.'0 


u 


u 


0 


' 0 




No Answer / 

11 w f»i iw n wi 1 


0 


IP 


• 0 


0 


. 0 


6 


'0 


0 


n 
u 


n 
u 


.0 


0 


■ 


None 


1 


2 


1 


7 


0 


0 


0 


0 


Q 


0 


1 


3 




Flempntarv 


0 


0 


0 


0 


0 


0 


0 


0 


0' 


0 


0 


0 




Snmp 'Hi an School 


4 


7 


0 


0 


2 


14 


2 


8 


3 


12 


1 


3 


Father's 


High School Graduate 


15 


CI 


5 


33 


5 


36 


-5 


10 


/; 
r 


01 
CI 


8 


28 


Educational • 


Some Post-H^gH School 


14 


26 


3 


20 


2 


14 


9 


35 


8 


31 


6 


21 


Level 


fnllpap Rrr^duatp 

\j\J 1 1 CMC ^* dUUU 


7 


M3 


2 


13 


0 


0 


5 


19 


3 


12 


4 


.14 




Some Graduate Stuby 


3 


6 


0 


0 


3 


21 


0 


0 


2 


8 


1 


3 




Advanced Degree 


4 


7 


\ 


7 


• 1 


. 7 


2 


8 


1 


4 


3 


10 




No Answer 


5 


9 


2 


13 


0 


0 


3 


12 


1 


4 


4 


14 




.3.50 - 4.0d^(A) 


3 


5 


1 


7. 


1 


7 


'1 


4 


1' 


4, 


2 


7 




2.50 - 3.49 (B) 


19 


35 


5 


33 


3 


21 


. 11 


42 


7 


27 


12 


41 


Previous 


3.50 - 2.49 (C) 


24 


44 


8 


53 


7 


50 


9 


35 


13 


50 


11 


38 


Grade-Point 
Average 


0.50 - 1.49 (D) 


7 


. 13 


1 


7 


2 


14 


4 


15 


5 


19 


2 


7 


♦ 


0.00 - 0.49 (F) 


1 


2 


0 


0 


0 


0 


1 


4 


0 


0 


1 


3 




Not Available 


1 


2 


0 


0 


1 


7 


0 


0 




0 


1 


3 
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' • TABLE 2.12 

BASELINE (2/74) DATA ON FWS STUDENTS B)(^RADE LEVEL AND SEX 

■ (Continued) 



Grade Level 





• 


Group 


•10 


11 


12 


Male 


Femal e 






N- 


C C 

55 




lb 


; N^4 


'N=26 


N=26 


N= 


29 


Variable 


value 


IT 


% 


N 


' % 


N 


% 


N 




N 




N • 






DeLLer) iiicej 






1 














27 




17 




Get Education ' 


T2 


22 


' 5 


33 


3 


21 


4. 


15 


7 


5 


Primary 


Different^ Change, 


















8 


31 


11 


38 


Reason for 


Meets Personal Need ^ 


IQ 

1 V 


ou 




Cm / 


6 


43 


9 


35 


App lying 
to FWS* 


Dislike Previous School 


13 


24 


"4 


27 


2 


14 


7 


27 


4 


15 


9 


31 


(9/73 post- 


Career Exploration ^ 


6 


11 


1 


7 


2 


14 


3 


, 12 


' 3 


12 


3 


10 


entry) 


Job Training; i> ^ 
Jget Ready for Work 


4 


7 


1 


7 


r 


7 


2 


8 


3 


12 


. 1- 


•3 




No Answer ' ' ^ 


1 


2 


0 


0 


0 


. 0 


1 


-A 


1 


4 


0 


0 




Better, Nice, 


















10 


39 


10 


35 




Get Education 


20 


35 


9 


60 


4 


29 


7- 


27. 


Summary of 


























Reasons for 


Different, Change, 








60- 


14 


100 


17 


65 


14 


54 






Applying 


Meets Personal Need 


40 


73 


9, 


2-5 


90 


.to FWS* 


Dislike Previous School 


.33 


60 


7 


47 


8 


57 


18 


69 


13 


50 


20 


69 


(9/73 post- 


Career Exploration 


21 


38 


3 


»20 


4 


29 


14 


54 


10 


39. 


11 


38 


entry) 


Job Training; 
















.8 




27 








Get Ready for Work 


9 


16 


4 


27 


3 


21 


• 2 


f 


2 


7 


V 


No Answer 


1 


2 


0 


0 


0 


0 


1 


4 


1 


4 


0 


0 




* Primary Reason for Applying to FWS includes only the first reason given by students, 
' Summary of Reasons for Applying to FWS includes first, second, and.third reasons,, 
if students gave them. 
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Comparison's of Group's Between FWS and -OPS - [' 

Compan'son of Whole FMS Population (Group W.y With Random OPS Population 
(Group E ) ^* . \ ; 

In that Group E is representative of the OPS high school population, it 
would be valuable to compare charrges in this group 'over the year to changes 
measured in the FWS students (Group W\. However, the degree to which such 
comparisons are meaningful is limited by the level) of similarity of . the, two , 
groups. The demographic data collefcted on Gjccuj^ and Grd?t> W were shown^in 
Table 2.10. . <^ / . 

Chi-square tests on these variables yield differences significant at the 
.10 level on three variables: ethni c affi liation, grade level, and leng-term 
fanning. The ethnic, composition of the two groups are markedly different. 
The figures on Table 2.13 contrast the percentage compositions of the two 
groups with -documented 1972 composition jif the .Oakland senior high schools. 
Several, conclusions are appeiiren*^from this p»*esentation: 

° Groups W (FWS) and E (Random OPS) are of markedly different ethnil; 
composition; 

° Groiip E represents the bladk population of OPS accurately, but 
/ somfewh^ under-represents other minorities;* ' ^ 



TABLE 2.13 
£thnic Composition Comparison 



Ethnic Background . 


Group W 


Group E 


Oakland 
Public 
School 


Black 


11% 


'65% 


63% 


'White 


53% 


32% 


22%^ 


Chicano 




0% 


8% . 


Other 


- ■ 4% 


3% 


" 8% 
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*Statistical Chi-squ*a're test of Group E- and reported OPS ethnic breakdown fi 
gures show Group E- to b^<^ representative sample of all OPS. ^ 



Grcufp-W over-represents white and Chicano and under-represents 
bl^ck students. As a whole J Group W under-^represents other ndn- 
whfte gjTOups,, ( - 

From tfiese facts, it is .clear ^that any comparison of outcomes between 
^eroiip W and Group E must contain a careful consideration of al ^implications 
of groups* differing ethnic balances'. 

' Comparison of Random FWS (Group C) with Random Control .(Gr oup D) 

^Groups C and D form the basis of the design for' the evaluation of 1973- 
74 program outcome, being randomly selected treatment and control groups re- 
spectively. The small sample sizes of these two groups reduce tlje scope of 
information that can be developed through 'comparisons, dnd make fnore difficult 
the task of statistical inference. Nevertheless, they may provide some approx- 
imation to a rigorous analysis of ^tear-end program •putcomes. 

The two groups are products of stratified random sampling from a common 
pool. Jhe variables used in the stratification wera grade level and size of 
minority population at previous high school. Table 2.10, columns 9-12, pre- 
sents data for the composition, of Ghjup C and Group D across demographic var- 
iables. Table 2.11 shows the means and staadard deviations for age, grade 
level, and GPA. A Chi-square test applied- to "each variable shows no signifi- 
cant difference between groups. 

During the process of .'student sel'ection in August 1973> each prospective 
student was asked to give his main reason for applying to FWS, and also to - 
list any other reasons he had for applying. These ^ata are separate from 
the similar demographic data collected across the FWS in September 1973, shown 
in Table 2.10. The comparison of Group C and Group D on this^ question is 
. shown in Table 2.14; Also shown are the September responses to the question 
by members of Group C after selection into the program. . In August the two 
groups agreed quite closely both on their primary reasons for applying .to the 
program and on a summary of all reasons for applying to the program. After ' 
selectiojj into the program,, members of 'Group C gave somewhat different reasons 
for applying: need for a "better progrclm|' or for a "change" markedly in- 
creased; desire for "6'araer explora-tion" decreased. The most obvious hypothe- 
-sis is tJiat tlie earlier responses were sometimes affected by students' desjre 
to be selected into the program, i.-e., occasional efforts to give an answer, 
sought by EBCE staff. Later, after selection,' some students responded more 
candidly. 
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TABLE 2.14 

REASONS FOR APPLYING TO FWS: ' 
AUGUST 1973, P^E-ENTRY AND SEPTEMBER 1973, POST-ENTRY 







9/73 


Group C 


1 Group D 


Group C _ 




Reason 


Importance* 


•N 


% 




% 


N 


% 


Better; 
get edu 


nice; 
cation . 


Primary 
Summary 


2 
3 


13 
19 


2 
3 


15 
23 


5 
7 


29 
41 


Differencei change; 
meets personal neeck^ 


Primary 
Suiimary 


8 

. n 


r~ 

50 
69 


6 

\ 8 


46 
62 


9 
16 


^53 
94 


Dislike previous school 


Primary 
Summary 


1 
1 


6 
6 


0 
- 1 


0 

8 


1 
6 


6 

• 35 


Career exploration 


Primary • 
Summary^ 


5 
7 


-31 . 
44 


6 


"31 
46 ' 


2 
5 


T 

29 • 


Job training; 
get ready for work 


/ Primary 
Summary 


0 
1 


0 
6 


1 * 

2 . 


■ 8- 
15 


0 
3 


0 
18 


TOTAL 


Primary 
Summary 


^ 16 
23 . 


100 
144" 


13 
20 


. 100 
153. 


17 
37 


100 
218 



* Se^ note on Table 2.10 for definitions of Primary and Summary. 
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All evidence suggests that the two groups, were."' qui le comparable on the 
demographic variables^ati the time of selection. Since that 4;imeV each group . 
has undergone some ati^fition". -Statistical analysis by Chi -square, test reveals 
no significant differences between the sets of cfibpe rating members of these 
two groups. , . " - 

Summary oHSfoup Comparisons 

The following statements suirinarize the comparison of student samples in 

the fall semester across demographic variables: 

< ' • <f 

l.^The group of FWS students returning from 1973-73 is quite different ^<:^ 
in composition from the entering FWS groups, 

. ^2. The groups of students first entering FWS in falU1973 are veS similar 
in composition, 

3, The experimental group and control group are very similar in composition, 

' 4,. The randomly selected group from OPS appears to be representative of 
the OPS t)ign school population, " ^ - ^ 

5, The group selected randomly to represent ORS is different in composition 
from the control group and from each of the groups of FWS student^s. 



chapteb-*s >pr06ram outcome data 
Introduction ' , , 

. Stpdent programs at far West School (FWS) are highly Individualized. The 

. . ^ structuring of educationaT experiences is, unconventional. These two facts make 
precise assessrnent of the program's outcomes diffixult. In the absence-of any 
single technique capable of measuring can educational treatment like FWS, evaluators 
have relied on an eclectic approach with a variety of instruments, methods, 
and data sources. ^ / ^ , ^. , / 

itT^his section program outcome data are divided into two categories: 
perceptions of 'the FWS program held by students, parents, and resources; and 
progress of students in EBCE goal -related areas. In presenting the perceptions 
of students* parents, and , resources., information is organized by instroment 
Jised for collection. In the crucial area of student outcomes, data are organ- 
ized, according to four primary areas of program concern: self-development, 
' interpersonal skills, basic skills, and career awareness and planning. ^Within 

these areas a number of questions relevant to the effectiveness of the program ^ 
are asked with answers coming from^a variety of instruments and data sources. ^ ' 
The sources of data used ta answer a question are indicated directly following 
the question. ^ ' \ 

Instruments and Procedures for Collection of Data 

. . 

. Fourteen Instruments (questionnaires, rating scales, interview schedules, 
and performance tes'ts) are listed in the data collection schedule. (See Table 
3;1). FWL-EBCE staff either deve}oped by itself or in cooperation with NIE and 
staff at the other EBCE sites all of the instruments u^ed except the standard- 
ized Iowa Tests of Educational Development. The Career Maturity inventory and 
the Personal Orientation Inventory were not used in the final collection period. 
Detailed infonnation about the development and assessment of instruments is pre- 
sented in Appendix C, along with a description ot the data collection proced Tes. 

• A number of reliability and validity studies were undertaken in relation to 
certain of the measures. -Scales were developed for items of the Job IRelated At- 
titudes; interrater reliabilities were studied for Writing Sample ratings; and 
coding schemes for- free-response items were constructed and interrater agree- 
ment ascertained. > ' , 

Data were collected using these instruments under conditions that were ^ 
made is uniform as possible, but loften the data were late and sometimes could 

O • • 39 . 
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•I TABLE 3.1 
OUTCOME DATA COLLECTION SCHEDULE,* FY7^ 



Instrument 



Early Collection 



Dates 



Groups* 



Mi dyea r Collection 



Dates 



Groups^ 



YeaV-En'd Collection 



Dates 



. . Groups* 



K ^ Resource Questionnaire 
2. Resource Interview 
3* Parent Questiqnnaire 
4* Miclyear Parent Interview 
5» Student Questionnaire 
6** Miclyear -^udent Interview 

7* Student Background Sunmary 

a. Part I 

b. Part II 

t 

8; ^ Initial Planning Form " ^ 

9. Student Plans and Perceptions Summary 
a. Part I 

• ' b. .Part II 

10. Student Change Scales 

11*^ Attitudes Toward Uarning ' 
12* Job-Related Attitu(Jes • 

* • 

13. Iowa Tests of Educational Developnnint 

14. Writing Sample (essay) 



9/73 

9/7? 
9/73 



9/73 
11/73 
8/73 



FWS, Control 

FWS 
FWS 



FWS 

FWS, Control 

4 

FWS 



2/74 

2/74. 

2/74 

2/74 

1/74 

1/74 

1/74 



Active RPs,. 

Active RPs 
RO Coordinators 

FWS Parents 
FWS Parents 

FWS • 
FWS, Control' 



OPS 

Representative 



5/74 



Active RPs 
RO Coordinators 



1/74-2/74 
1/74-2/74 



FWS, CtfntroU 
OPS 

Representative 
FWS, Control 

' OPS 
Representative 



see SPPS 

5/74 
5/74 
5/74 

5/74 
5/74 
^^7 A 



FWS,\ontrol,- ' 

Representative 
FWS • 



LCS 



FWS, Control,, 
OPS 

Representative 
FWS, Control* 
OPS 

Representative 
FWS 



*See Table, 3. 2 for definitions of these students saiiples. RP » Resource Person. RO = Resource Organization. LC ■« 
ing Coordinator. 



not be collected in the quantities planned. Care was taken that the data be 
correctly punched and that various analyses be correctly performed. The data 
collection instruments listed in Table 3,1 were completed by the^ following 
groups: resource people, parents, FWL-EBCE staff ,/FWS students, comparison 
students from Oakland pubVic high schoolfs, wi professional interviewers. 

The interview schedules should be gi vei/vspecial note since all the io- 
terviews were conducted by external contractc»s who also analyzed and int^ 
preted the-content. Such an externally managed effort was selected tp>pro vide 
a fresh perspecti ve(cKa4 a means of accumulating data that would ^c^riiplenient and 
enrich the spectrum of instruments used in the study. 

Of the fourteen instruments listed in Table 3,1, those numbejped 1-5 and 
10-14 are introduced, in the parts of this section in which data are presented 
and interpreted. Instruments 6-9 are discussed briefly here because they were 
used to provide data for more than one topic, due to the heterogeneity of the 
items in the instruments. More detailed descriptions appear in the appendix 
as do copies of most of the instruments. 

Item 6: Midyear Studpnt Interview , 

Information was collected on a face-to-face basis by professional 
interviewers experienced primarily in market research surveys and 
with no prior experience in or knowledge of Far liest School, The 
^ bulk of the interviewing was done by two interviewers who were^ 
"'randomly assigned to interview students^from the various groups. 
Sixteen FWS students and 14 OPS students were intprviewed^ During 
the interviews, which were tape-recorded, the interviewee/ also 
, .wrote the students* responses on questionnaire forms. Afterward, 
the interviewer listened to the tapes for omitted, additional, or 
corrected information for the forms. The information on the ques- 
tionnaires was coded by two professional coders who did no|: assign 
responses to predetermined categori es but, rather deveToped cate- 
gories for each question from the interviewer's written responses. 
Generally a category was established if more than one response de- 
fined, it; unique responses were placed in an "other" category. 
Since the percentage bases are smajJL^ny percentage differences 
between groups on any item of information should be viewed with 
caution, . Tables associated with student interviews appear in Ap- 
pendix C. 

- 4 



Although not listed in Table 3.1, there wer^ other sources of data used for 
evaluation. These are described and discussed in the two succeeding chapters: 
Outcome Backup .Research and Model Development Gr.d Implementation. 
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Rem 7: Student Background Summai^y- . 

Most items in the Student Background Summary wera developed jointly 
with the other three NIE-EBCE projects. This instrument was admin- 
istered at the beginning of the year. . The'*questions repeated in 
the Student Plans and Perceptions Summary (SPPS), (test 9), admin- 
istered at the end of the year, ask for post-secondary plans (one 
year after) and long-range plans (five years after). 

Rem 8: initial Student Planning Form , 

Like Test^, th^s test was administered early in the year and re- ^ 
peated in part at year-end in the SPPS (test 9). Rems in comwn 
had to do with activity and career interests and judged school pro- 
gress in relation to expressed needs for assistance. 

Rem 9: Student Plans and Perceptions Summary . 

The title "Student Plans and Perceptions Summary" designates a 
compilation, of questions and rating scales administered at year- 
^ end. Some items appeared in instruments administered early in the 

year, as indicated above. The instrument contains two parts: , 
Part I was administered to all student groups andPart II only to 
FWS students. Major purposes for the instrument w&Te: (1) to ob- 
tain year-end opinions of the students on their respective school 
programs, (2) to compace FWS students* future plans and current 
interests'with those of Oakland Public Schools (OPS) students, ^ 
• and (3) to obtain information* from FWS students on the success of 
specific aspects of the FWS program. 

Sea Appendix C for more detail. 

_Groups and Procedures for Analysis 

Result*; are presented separateTy with each question explored. Major com- 
parisons were the FWS experimental group versus OPS control group, and the FWS 
Entering Students versus OPS Representative Students. (See Table 3,2 for iden- 
tification of student groups.) Some resifnfs were also obtained for all FWS stu- 
dents versus all comparison students, "Statistics have been used fon inferential 
purposes only when the FWS experimental group was compared with the OPS control 
group. 

The outcome evaluation involved many statistic^ analyses ,*'S.0mie of them 
involving considerable ctoniplexity. Consistency of results over different com- 
pan SI on groups and measures was taken as evi dence supporting or not supporting 
hypotheses concerning FWL-EBCE effectiveness . ^ • 

A variety of statitical treatments were employed, including analysis of ^ 
covariance, independent group t-test, Chi-square test for interaction relia- 
bility analysis, and multivariate analysis. 



O ^ h 42 

ERIC 



1 



TABLE 3.2 

^ IDENTIFICATION OF STUDENT GROUPS 



\/v — 



Grouph 


Type 


) 

School 


status , 


Selection 
Method 


Midyear* 
N 


Endyear ' 
N • 


A 




FWS 

• 


Returning 


Criterion 
selection ' 
previous 
year 


14 




r 

11 




0 


• 


FWS 


Entering 


Criterion 
selection 
summer 
1973 




4 






3 




B 




FWS 

1 ' 
1 

1 


Entering 


Criterion 
sc 1 cci. lun 
■spring 
1973 




20 






19 




C 


Experimental • 


1 FWS 


Entering 


Random 
selection 




17 




13 
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-35- 












sunnier 
1973 K 










D 


Control 


OPS 


* 


Random 
selection 


14 




12 




i 








summer 
1973 










E 


Representative 


OPS 






.31 




24 























' *Attrition of students during the year resulted in a nmt=7ear enrollment of 
55 and a year-end enrollment- of 49, as described in Chapte»: 2. In-analyses 
based on the mid-year collection, N = 55. In analyses vbasad on the year-end 
colledtion, data were deleted for two students who compTetrd only/part,of the 
summativ^ battery and for the one student who had returned to FWS after a 
semester in junior college. Therefore, for-year-end analyses, N = 46. 
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The analyses were carried out using a number of different facilities. 
Much of ..the baste work of subscale^ scoring and generation of descriptive sta- 
tistics was cxirried out by a subcontractor. These data were then processed by 
the Far West Laboratory computer, \the University of California at Berkeley's 
Computetr Center, or in the case of the analyses of covariance, by th^ Educa- 
tional Testing Service Data Processing Center. Where statistics had been 
obtained in early collection periods for students not present for later collec- 
tion periods, the statistics <v(ere recomputed with the reduced number. Thus, 

the N for the analyses varies somewhat* ? 

• 

PERCEPIIONS, ATTITUDES, AND OPINIONS ABOUT FWS 

Students ' • ' * 

• 

Student Questionnaire 

The evaluation directors of the four EBCE projects agreed to collect infor- 
mation from EBCE studervtS: concerning their opinions about \|arious aspects of the 
program. For this purpose, a set of 38 questions was prepared covering reasons' 
for-entering the school, general .attitudes toward the school relative to^others 
the students had attended, egid opinions about particular aspects of the school 
program. The questions wgr.e p/fesented so students could answer each on a 5- 
point scale, with the two end points of the scales labeled "Definitely Yes" . 
versus "Definitely No," "Poor" versus "Excellent," or "Not at All Important" 
versus "Extremely Important," according to the nature. of the questions. The 
student opinion questionnaire is presented in Appendix C of this report; It 
was used by all four EBCE sites, 

' The questionnaire' was designed to obtain^opinions about the particular 

4 

features of EBC'E at the four sites, and so could not be meaningful to students 
in control or comparison groups. The decision was made that a positive or 
negative opinion about ths Far West School woul^, always be Indicated by marking 
the same end of the scale on a given item, since this would simplify the task 
of the students responding to the questions. In making this decision, the EBCE 
evaluators recognized that a positive or negative response set could have an 
influence on the responses to particular questions, thUs possibly making indi- 
vidual question responses somewhat less accurate. It seemed best to use a 
simple method that could be biasdd in this way rather than risk the antagonism 
towar'd the entire data collection activity that might result from the use of 
more elaborate methods necessary to reduce the response bias. 



. The. questionnaire was administered to all FWS students, but the daja and 
interpretation presented here are based only on those students who entered -in 
Septeinbi|r 1973. The results from this questionnaire are presented" in Table 
3^ The response to all of the questions indicated generally P5«^"tive opinions 
about th.d Far West School. Therefore, it seemed essential to establish some'^ 
criterioi^or interpretation of these responses that would allow for the iden- 
tification of the strongest features of the school iand of those which may need 
improvement. .First, the .5-point responses were reduced to three response classes 
positiyei neutral, and negative. This rejluction was based on the assumption that 
the choices between degrees of cfositive or negative opinion were largely idiosyn- 
cratic and that the development of a much more- sensitive instrument would 'be re- 
quired to distinguish t|;iese with any real reliability. Second, the average num- 
ber of neutral responses on all of therms was determined, and the assumption 
was made that if students were responding at random, half of the remaining re- 
sponses would be positive and half negative. Thi* procedure permitted the de- 
termination of a set of expected frequencies for random responses of the 39 stu- 
dents who had entered FWS in September 1973. Two students who entered at that » 
time did not complete the questionnaire. 

When tested against this criterion, all of the responses yielded statis- 
tically significant Chi-squSre values, indicating that the students were posi- 
tive about the school and all of its features. This analysis was judged inade- 
quate for identifying the school's outstanding features, so the responses were 
further reduced to positive versus neutral or negative responses. The positive-|>, 
responses wereythen tested against a random-response criterion of 50% posit^e 
and 50% neutral or negative, using a t-test. Twenty-nine of the 38 quest/ons 
yielded t- tests in excess of 2.00,; so it was concluded that st^ents are posi- 
tive in their opinions on most, but not all, of the features of FWS. 

The problem of positiver response set mentioned above made the interpreta- ' 
tion of the'resulting t-tests still somewhat uncertain, ^however. The decision 
was made to use the average value of "t" as a criterion for the identification 
of the features of the FWS program about which the students were most positive, 
as opposed to those features which, wf\ile positive, could be improved. '.This 
average value was 2.96; as it turned out, the minimum value for any t-test 'in 
excess of this was 3.25, which is, of course, a very conservative value as an 

indicator of' positive opinions about the school. 

1 ■ • • " 
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, TABLE 3.3 v 

FREQUENCY OF STUDENT OPINION RESPONSES ANO VALUE 0»^<ty 
FOR POSITIVE RESPONSE BY OPINION CONTENT CATEGORY 



Content 
Category 



L Gencril 
Pro9rafl 



Question 



1. Have you liked attending the career education prograia? * 

33. In 'comparison with pSst experiences in regular schools, how motivated are you to learn in the 

career education prograa? 
3>. In comparison with regular schools, how much Opportunity did the career education progran 
"provide you for leaw*ning about occupations? 

2. If iou hid it to do over ftS'in, do you think yoo would decide to participate in the career 
education program? . « 

23. Would you say the^areer education'program has^ helped you for« cwe^r Pl«ns? 

24. * Would you say you've learned a lot while attending the-career'edUcation program? 
26. How would you rate the general quality of the career educatiop program?" 

2K Through your experiences in the career education program, have learned a Tot about 
opportunities for the future? « 

32. In comparison with regular schools, how much opportunity did the career, education prograu 
provide you for general learning? ^ 

Z5. How well organized and coordinated do you liink the career education progran has been? 
6. Do you get enough feedback about how^well you are doing in the program? 



Response Gvoup 



Negative 



Neutral 



0 

1» 



2 
S 
4 
7 

6, 
7 

10 
9 



Positive 



Test 
value 



38 
38 

37 

35 

' 34 

33. 
31 

31 

28 

25 
21 



Resources 



19. In general, have you felt welccroe at the e«ployer/resource sites? 
10. Have you had enough choice in selecting the types of employer/resource -sites you visit? 

7. HaVe you had enough choice in deciding the amount of'tV* you spend at eiaployer sites? 

8. Have you had enough choice in deciding the amount of time you spend in learning academfc subjects? 
29. How would you rate the general quality of thi6 career education program employer/resources 

you've worked wlthj 

16. >n general, were the eff^loyer/resource personnel involved in the ca^^eer education program aware 
of your needs and interests? ^ 

9. Have you had enough choice in deciding what you dO at employer/resource sites? 

18. In general, have the en^loyer/resource sites you've visited been interested in the career 
education progran? 

17. In general, at employer/ re source sites did you get to actually do things ;-ather than Just listen? 

20. Oo most^of the efnpl<5ycr/resource sites you have worked with let you know how you're progressing? 



5 
6 
2 
11 
7 



6 
2 
-6 
5 

10 

8 

7 

13 

8 
18 



33 
33 
31 
29 

. 26 
26 
26 
24 
20 



Activities 



• In the career education program, have you felt that >(ii^ould progress at your own rate? 
Have the activities available ip the career educatiol p^ram been interesting to you? 
How would you rate the personal counseling available in the career education program? 
How would you rat« the career counseling available in the career educatjoh program? 
Have you seen Bueh of a relationship between your activities in the learning center and the 
careers you have learned about? ^ ' 



4 

6' 
4 
9 

14 



Jobs 



14. 'In general, are you looking forward to working in a Job? 

15. Do you think you have much choice of occupations? 

12. Oo you think that if a person works hard enough* he can achieve anything? 
11. Do most people receive much satisfaction from their work? * 

13. Do' you think that the main reason a P«rson works is to earn money to live? 



2 
1 
5 
6 
11 



5 
7 
4 
12 
9 



33 
32 
32 
27 

24 



32 
31 
30 
21 
19 



* Indir^tes a positive opinion. See text. 
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Hoi^ did' students perceive the general program? 

Th? students- were in general quite positive about attending FWS and felt 
more Wtivated 'to learn than at their previous school. If faced with the-choice 
again, they, said they would enroll again in the program. They were also quite 
positive in responding that the school provided more opportunities to learn 
about the future, to form career plans, and to learn about jobs^th^ their pre- 
vious school.* Although the students were not predominantly negative about any 
'aspects o4 the progranv they were less positive about the organization of EBCE 
and the feedback. they received about their learning. 

How did students perceive the external resources? 
'V^jhen asked their opinions of the resources available to them, ^todents 
w6re very positiv^ about the amount of choice they had in selecting employer - 
sites and detferminingrtjje^tjme tHey^ent at the.sites; they had»very positive 
opinions' of the welcomf they reJGd^t the sites. The students.were somewhat • 
"less Piis-itive, or more uncertaiji. in thei^inions of the geny-al quality of 
'the employer sites, the opportuiities to do things rather than ^ust listen at 
the" employer "sites, thejnterest in EBCE on the- part of the employers, and the 
-employers' awareness of student needs and progress. 

^How did students feel about the program aotii^iUes? 
» .The very positive opinions students held -about activities in the program ' 
related to their" interest in these activities, the fact that they could progress 
at their own rate, 'and the .kind of personal counseling they qould get. Thpy 
were less positive about the apparent relation of activities at the. learning 
center to the careers abqut which they' were learning and the career counseling 
. they could get in the program. 

^ Student Interview ^ -. 

noa does FWS differ from regular high school? 

The 'FWS students were unanimous in their judgment that FWS was indeed dif- 
ferent from regular ^hfgh school, and most of them (94^referred FWS to regular 
high school. The main reasons given for the difference were that at FWS the stu- 
dent "^uld get practical .experience (50^), and learn what he wanted on his own 
schedv.U (31%); there was room for individuality (25%) ,. preparation for'the out- 
side worldS+9%), and he had more freedom (12%). (See Appendix C.) 
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Hob) do they view the learning ooovdinatov^s job? ^ 

The learni ng coor slinator was viewed as a friendly, helpful advisor. IJie 
statements mentioned most often were "helped me^ find RPs-, ROs, CRs*' (50%) 
"like a close friend; easy to talk to" (44%). No student characterized the 
LC's job as that of a "teacher," although his monitoring function was expres'^ed 
by some with sucK responses as" fchecks up on my activities" (12%) and "makes 
sure Infill out forms right" (6%). The perception of the learning coordinator's 
job did not differ^eatly for the three LC?. (See Appendix C.) 

^ * How do students feel they have benefited from experience with the resource 
persons? 

Nearly all FWS students (94%) said they had benefited from their exper- 
iences with the resource persons. The reasons given most frequently were that 
they "learped something" or "learned a lot^'- (62%) and that the resource person 
helped them to decide on a career' (1^%). (See, Appendix C. ) 

How ^Bt students feel they have benefited from their experiences with re-- 
source organizations? , , 

Most FWS studepts (56%) felt they had Benefited from the resource organ- 
izations, but some students (31%) were sure they had not benefited. (See Ap- 
pendix C) I ^ ' ' , 

How do students feel they have benefited from experience with community 
resources? * ' ' ' 

Again, most ^WS* students felt they had 'benefited from the community re- . 
sources (56%^, while 12% said they had not. (See Appendix C.) 

• ffoy di\ students rank the resources in importance? 

The FWS students were asked to rank the resources in order of their im- 
portance to them. The order was the respurce person (75% first-place votes), . 
the community resource (12%), and^the resource organi2ation (6%). The major ' 
reasons for ranking the resource person first were tnat he offered a pne-to-one 
relationship (44%) and that one can learn more or leahv^ lot with a resource^ 
person (38%). - 

mat did students like best tind least about their am school? 

More FWS students (75%) than control students (29%) had overall, unquali- 
fied, positive attitudes about their school. More contl|;^oT^udent^(^ than 
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FWS students (none)* had an overai\ unqualified, negative attitude about their 
school.' The "opportunit)\to^make own schedule" was mentioned by more FWS stu- 
dents (44%) than contrpl students {7%). A ''particular teacher or particular 
class" was mentioned by most control students (89%) as what they liked best, 
but not at all by. FWS students. The things liked least by FWS students were 
filling out forms (3U), tests (19%), and-poctr organization at FWS (19%). Some 
^control students said their school was all ba'd (36%); others said that the classes 
the> wanted were always filled (14%J, and that they did not learn much (14^). 
(See fible 3.4'for results* ) v 

The FWS students were asked' whether they preferred the Far Wfst School or 
the regular high school and what school activities they missed. (See Appendix 
C.) Nearly all FWS students (94%) prefferified Far West School ; only one' 
student- pre ferr6d regular high.schoof. The regular school activity missed 
most by ^fW^students was spor^ (31%). A few students jnissed their friends and ' 
some specific courses, but most students (56%) had not missed anything from re- 
gular high school • * * ' 

Student Attitudes Toward School and Igarmng 

The FWS-EBCE staff prepared a questionnaire on opinions about school and ^ 
learning with 21 .items: 9 open-ended question^ and 12 objective questions. 
It was administered in Jariuar^y 1974 to students enrolled in the Far West School 
program and to students belonging to control and comparison glpoups^. 

The results are first discussed in terms of the differences between the FWS 
Experimental Group C and the OPS Control Group B. The rationale fcir this com- 
parison is based on the fact* that "these two groups are the only randomly assigned 
groups^nd therefore the only Instance where differences between groups might be 
attributed with some confidence to\Dr^g^^ A brief discussion of the 

differences between two other groups, those J^ntering FWS in fall 1973 (Group OBC)^ 
and the OPS sample (Group E) follows.^ The differences between the experimental 
and control groups provide an opportunity for the reader to gain some impresTvl^s 
as to the impact the FWS program may have had on the participating students in 
general. , The impressions must be tempered by the knowledge that selection pro- 
cedures* and initial differences in people might have compounded whatever program 
effects exist. 

Not all af^the 21 questionnaire items are included in the following presen-/ 
tation. Some of the objective items were^ eliminated or not examined becaoswthey 



' . TABLE 3.4 ' • 

AniTUDES ABOUT SCHOOL REFLECTED IN STUDENT INTERVIEWS 



J 

student (Z^tfracteri sties 

1 


FWS ^ 
Experimental 

ID 

^ % 


OPS 
Control 

W-1 A* 
N- 1 f 

% 


nv/ov^iill nriCT'^TX/o Tk^^A^wtKc^ ' 
uvc rati 1 0 1 Vc a t L 1 LUUc 






Overall negative 'attitude 




50 


Both positive and negative attitudes^ 


25 


21 








Opportunity to explore interests 


\d ^ 




Opportunity to make own schedule 


44 


7- 


Everyone gets along 


37 


14 


Freedon)/inde pendente (unspecified) 


25- 




Explore life outside/in community 


6 




Exploring jobs ^ * , 


6 




Particular teacher/particular class 




89 


LiKea least aDout scnooK 




* 


Filling out forms/too many forms 


31 




All tests/tests are worthless 


19 . . 




.Things take too long to get done 


6 


Poorly organized/should be better 
organized 


19 




Staff cut off from students/need' 
more infonnation 




' \ 


Studepts don't have enough say 




Don^'t like it/the school is bad 




36 


Classes wanted are always filled 




14 


\ Didn't^ learn much 




14 



were. ambiguous or judged distractor items; others because all the -students' 
■chose the socially desirable rdsponSe. Some of the open-ended items were not 
included' because a large proportion of responses were program-specific and 
comparisons between groups could not be made. In addition, items which did 
not have a,ny of the above" characteristics are' not reported if they di^ not 
differentiate between -the experimental and control gro^. The disposition 
an*d detailed results of each'-of the 21 items may be found in Appendix C. 

• .In reporting differences between groups, severiil things have been kept in 
mind. First,' though results have not been given for all responses, the^re- 
spdnse" categories with highest frequency have always been incHtded. Second, 
absolute'differentes in. percentages have always been -tampered by a considera- 
tion of the total number of people in 1»|^e group, the distribution of responses 
• over the categories, and what information the question was requesting. In the 
comparison of the experimental with the control grqup, t-tests utilizing propor- 
tions were used. when appropriate; i.e., for some of the open-ended questions, 
t-tests could not be performed because coding categories were collapsed. No 
tests of significance were performed on the differences between entering stu- 
dents and the OPS comparison tSroup E bec^s? initial group differences made 
tests inappropriate.. , ■ i . . - . 

mat are the com^rative attitudes toQavd school and learning bei^Jeen the 
exper>itnental and qpntrdl groups? ■ • ' • . 

In comparingnhe responses of the experimental group with those of the 
' control group, several important distinctions between the two sets emerge. The 
control group's opinions about school and learning seemed, typical of a tradi- 
tional high school program. They were not particularly enthusiastic about their 
school and did not feel they had any opportunities to choose what they would 
study (see Table 3.5). In cootrast, the experimental group indicated^ they felt 
unlimited opportunities to choose what they would study and were rather positive 
about the Far West Sch6ol . ^This is to be expected, of course, since most ex- 
perimental groups involved in personalized innovations are excited about it.) 

Although the cotitrol group irtdicated an interest' in learning about specific 
school subjects, they were not as interested- in the things they were lir^sently 
learning as was the experimental group. They fel^they learned most from people 
who helped them plan their work, and^elt the best way to teach someone was to 
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TABLE 3.5 

ITEM 5: WHAT OPPORTUNITIES DO YOU HAVE 
IN YOUR PRESENT SCHOOL TO CHOOSE WHAT YOU STUDY? 



r 



Coding Categories 

Used For 
. Comparisons 



FWS 

Experimental 
. K=18 
N=17 . 



OPS 
Control 
K=16 
N»14 • 



% 



-FWS 
Entering 
K=52 
N=41 



OPS . 
Representative 
K=45 
. N=31 . 



' Unlimite.d' opportunity* • 

Not offered wide variety 
^, of/not many courses to 
choose from 

Do not give courses I 
want; no courses I.'m 
interested in 

Not much/no opportunity* 
■ to take what I want; 
not allowed to choose 



10 
0 

1 



56 



28 



54 



13 



Other responses 
Do not know 



** 



0 

28 
11 



10 
0 



13 

63 
0 



0 

19 
4 



0 

37 
8 



3 
3 



33 
2 



7 
7 



73 
4 



* p :f_.Oi for experimental versus control. 
** Non-differentiating or program-specific responses. See text» 

RSiK: Percentages are based on the total number of responses (K). Because 
ituuents gave iDore than one response, K ma^ \be largt*" than the number of students 
in the gnoup (N), but not every student .responded to every question. 
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show them, or explain it (sjee Table 3:6). The control group was.sjiown to have 
a more negative attitude about the worth, of their program on both of the items 
requesting a description of the program* s benefits. 

The experimental group, on the other hand, shewed a more Independent work, 
style in describing, the pjeople they learn most from^ and the best way to teach. 
More than the control gi^^up, the experimental group tended to, think that prac- 
tical experience is the best^teacher*. -They were also ijiore career-oriented than 
the control group, and less academically ortented in descrfptions of their progress 



' TABLE 3.6 

ITEM 8:'. WHAT IS THE BEST WAY TO TEACH SOMEONE SOMETHING? 



Coding Categories 
Used for 
Comparisons 


FWS ' 
Experimental 
' ' K=18 
N=17 


OPS 
Control 
tC=17 • 
N=14 


FWS 
Entering 
K=48. ' ^ 
N=41 


OPS 

Representative 
K=38 
N=3T. 




f_ 


% ' 


f 


• % 


f 


JO 


f 


% . 


Practical experience/ 
experience/do it/try it/ 
let them do it 


'4 


22 - 


1 


6 




L. 33 
> 


5 


13 


Explain it/show how to do 
it/ go over step by step* 


2 


11 


6 


35 


8^ 


17 


9 


24 


Teach something ttiey are 
interested in/s6mething 
they want to learn 


1 


6 


1 


6 


3 


6 ' 


7 


18 


Other responses** t 


11 


61 


9 


53 


21 


44 


17 


45 



'* p £.10 for experimental versus control " - ^ 

**' Non-differentiating or program-specific responses. See text." 

NOTE-: Percentages' are based on the total number of responses (K), Because 
students gave more than one response, K may be larger than the number of students 
in the group (N), but not every student responded to every question. 
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What are the comparative attitudes toward school and learning betioeen FWS 
students entering in the fall and the representative OPS sample? 

As might be expected, the FWS group entering in fall 1973 is very similar 
'to its subgroup, the FWS experimental Group C. The OPS representative group 
is very similar to the OPS .control group. The FWS gro<jps-are highly positive 
about experiemces at the Far West School. More than 'the OPS representative 
sample, "members of the FWS entering group are learning about things -that 
interest them^ and they feel their program is far better than programs at 
previous schools. FWS entering stjjdents^ seem to be positive in their feeltngs' 
about tlie school. They feel 'they have an unlimited opportunity to choose what' 
they study and feel their program is- good both for academic work and career * 
planning. 

SPPS, Part II 

What are FWS student perceptions of ^their program at the end of the 
school year? ^ . ' 

Reactions were* generally very favorable. AlT>^arWest School students 
felt that students were getting at least "something" out of .the FWS progrcqji; 
half of them felt that students ^ete getting "a lot out of FWS." (See 
T^ble 3. 7 J The impressions of the group of first-year FWS students indicate 
that they are very well satisfied with the FWS program in comparison w),th 
previous schools attended. (See Table 3. 8 J 

FWS 'students were also asked "what advice' or comments do you haye for the 
>WS sta^?*' Responses fell into three areas' (see Tafcile 3.9): 
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TABLE 3.7 

END^OF-YEAR STUDENT OPINION OF FAR WEST SCHOOL PROGRAM- 



Item 
No. 


' Item 


FWS 
Entering 


18. 


The amount of personal freedom allowed 'students was: 
Not enough 
About right 
Too much 


2 

3a 

2 


• 14. 


The amount of work required of me" was: 
Top little '* <' \ 

About right ^ ' ^ ^ \ 
Too' much ' . • • ^ , 


3 

30 
1 


13. 


How do you judge the help you received in planning your 
activities? ^ 

Needed more help , 

About right 

More than Was needed * . ^ . ' 


4 

25 
5 


16. 

• 


The other EBCE students were '(by and large): 
Cold and/or impersonal 
Can't say either way 
Warm and/ or friendly 


0 

.' 4 
30 


20. 


The resounce persons you met were* generally: 
Dull and boring - - , 
Can*t say either way 
Interestinci and enjoyable 


.. 4 

9 

25 


22. 


* 

•The resource organizations visited were: 
Dull and boring 
Can't say either way 
..^Iflteresting and enjoyable 


4 

4 

25 * 


15. 


The staff ofFWS was^ (by and large): 
Doing a poor job 
Can't say either way 
Doing a gobd job 


0 
11 
23 


■19. 

* 


The things the resource persons of fered seemed: 
Of little use ♦ 
Can't say. either way 
Useful 


" 'l - 
11 
22 


21. 


The^hing^ the resource organizations offered seemed: 

yjT 1 1 J.J. 1 c Ubc 

Can't say either way 
Useful 


4 
7 

, 22 * 


17. 


Generally, the other EBCE students seemed to be geUing: 
Little or nothing out of FWS ' ^ - 
Something out of FWS 
A lot out of FWS 


0 
16 
16 * 



*j Item was left blank by one or more students 
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TABLE 3.-8 

st6denticompar1son of far west school and other schools attended 



■L 



Item: When you look back and compare your Far West School 
experiences with those you had in the schools you 
attended before, you are: ♦ 



FWS 
Entering 
Students 

N=35 



Much less satisfied withJ^ar West School than with the others. 
Somewhat -less satisfied with Far West School than with the others. 
About as satisfied with one as with the other. 
Soinewh'at more satisfied with Far West School than with the. others. 
Much more satisfied with Far West School than with the others. 



0 

0 
1 

3 
31 



/ 

TABLE 3.9 



ADVICE AND COMMENTS TO STAF£ BY FWS STUDENTS: 
DISTRIBUTION OF RESPONSE; TYPES - , 



r.r 

Y FV 



r 









' Grade 


Level 










Type of Response ^ 


in 


1 


12 


Total 










Entering 


Returning 








f 


% 


f 


% 


f 


% 


f 


% 


f 


0' 


General positive' obserr 
vat i ons about school 
and staff 


7 


50 


4 


36 


3 


2B 




22 


16 


35 


Statements with a pre- 
dominantly negative tone 


3 


21 


1 


10 


0 


0 




- 0 


4 


9 


Specific criticisms 
and suggestions 


4 


29- 




27 


/ 

8 


67 




45 


19 


41 


No response 


0 


0 


, 3 


27 


1 


8 


3 


33 


7 


15 


TOTAL 


14 


100^ 


li 


100 


12 




100 


) 9 


100 


46 


lUQ 



71 



Generally positive observations about school and staff . Examples : 

^ "Keep up the good work." 
* • 

"I am definitely glad I came here and benefit^ from 
the program, not saying that I learned a lot because • 
I took advantage of the' school but it taught me a 
lesson." ' ' , 

"Everybody did a good job. This school year was very 
successful." ' ' . 

"Well for one Far West has a very nice staff. There's - , 
• never a dull moment when you're around one of them. 
They're very friendly, warm and they treat you as though 
you were one of their Qwn kids." , ' . 

statements with a negative tone . There were only four staljements (all 
from younger students) which seemed predominantly negative in feeling. Examples: 

"The advisors are great but I could not say much for 
the rest." 

"FWS didn't do a very good 'job of helping evfiry one this 
year." " ' 

Criticisms and suggestions . Sugges^ions from the tenth- and eleventh-grade 
students were centered on details of curriculum (re,sources, packages, meetings),. 
*rwelfth-grade students, both first-year and returning, were much more direct 
in of feri-f^ suggestions to the FWS staff on improving their effectiveness in 
the program. > The specif4c suggestions made by t' e FWS^feniors to the FWS 
staff when asked for "advice and comments" are listed be\ow. 

1. "Far West needs student counseling or some perso| who" knows our 
program and can tell a student off in a tactful iianner." 

2. " "Not to be s(i loose with some-students. The onel that need more help 

they should give more attention to." | 

3. "Don't get too big because you might lose RP, R0, CR by too many 
y people missing appointments." / 
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J. "Need more LCs. Explain more in Orientation/ Push students a littl 
more to do work." 

5. ' "Keep up the good work, but cut down on t/e number of forms and tests ." 

6. "Not to get uptight in proportion to the/increase projected student 
body 75-76."' i 
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7. Listen a little more to the things students say— especial ly readirvg 
between the lines of what is said. Sometimes the rush is too 
important. Deadlines occasionally outweigh students.;' 

,8, "I advise Far West to get three more LCs on the 'staff and to get 
their shit together a little^etter." - 

9. "There is a need foti^more advisors on the staff." 

„ • -3 

10. "I think the staff has good intentions but don't always get full . 

cooperation from students. The staff sometimes needs to put more 
• . pressure on students about getting something done." 

n. "Doing a good job, but they might be a litt^le too lenient. I' 

J2. "Somehow find a way, forcefully or through coercion to get students 
more productive with their time and use of RPs, ROs, and staff." 

It appears that although FWS students express generaTYati's faction with 
the program and with the staff, the older students are well aware of the 
inherent conflict be tweenr' staff and students in a program that attempts, to 
substitute inner motfvation for external direction. 
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Pare nts 

■ — » _ " 

Parent Questionnaire - " [ 

Parents of students were asked to give t.ieir opinions of FWS through a 
questionnaire asking open-ende'd questii/is intended to explore the strengths 
and weaknesses of the program; positive and negative changes they had noted in 
the student, types of students they felt would benefit most from the program, 
and how they had learned bout the program. Fifteen Likert-scale items asked 
parents about program effectiveness, operation, and impact. (See Appendix C 
for complete questionnaire.) '.- 

The questionnaires were mailed to the parents or guardians of all 55 stu- 
dents. - At least partially completed forms were returned by 36 (65%) of the 
parents. The returned questionnaires appear to be a representative sample in 
teifms of student-group membership (see Table 3.10 below) and also student grade 
level and sex, and LC-group membership. 
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TABLE 3 JO 



COMPARISON OF NUMBER OF .PARENT QUESTIONNAIRES PROCESSED TO SIZE OF STUDENT GROUP 



1^ 


Student Group ' 


V 

Part of Questionnaire 


Total 
FWS 


FWS 
Returning 


FWS 
Entering 


FWS 
Spring 
Selection 


FWS 
Experi- 
mental 




N^55 


N=14 


N541 


• N=20 


N=17 


Part I: objective questions 
processed 


34 


9 




14 




Part II: open-ended 'questions 
processed 


• 36 


9 ■ 




' 15 


10 


Percent of total group for • 
open-ended questions 


• 65%-'-;, 


64% 

i - 


66% 




59% 



Objective responses on the questionnaire were coded, and frequencies of 
responses obtained jn the various categories. Open-ended questions were 
analyzed, and categories of frequently recurring responses were obtained. Be-, 
cause certair? parents left some of the questions unanswered, statistics were 
calculated solely on the basis of the number of "parents responding to the 

particular question. 

• Table 3.11 describes the fifteen items 'that are in Likert-scale form. 
Responses for these items were made on a 5-point scale, and mean scores for 
each item were, computed using the original responses. The frequency dist^^i- 
bution in Table 3.11 reduces the 5-point scale to three catagorfes: negative 
(level 1-2), neutral (3), and positive (4-5); the items are ordered in Table 
3.11 on the basis of the mean ratings. ^ 

• * 

mat was parent perception of the overall proyram and the ^ff^ot on their 
sons* and daughters? 

As indicated by Table '3.11, parents were almost unanimous in their opinion 
that their child liked FWS better than schools attended 'previously. They also 
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TABLE 3.11 

PARENT OPINIONS OF EBCE PROGRAM RANKED BY MEAN 



No. 


•Question , 
(Abbreviated Statement) 


Reduced 3- 


Level 


Scale 


Mean of 

%? U.CVC 1 

Scale 


Neg. 


Neut. 


Pos. 


Omit. 


1 

3 


How wen does your son or daughter like 
the program compared with past school 
experiences? 

* 




2 

• 


32 


0 


4.79 


7 


How much opportunity does the'program 
provide for learning about pccupations? 


1 


.0 


33 


0 


4.76 


• 

'10 


How motivated is your daughter or son to 
learn in the program? 


0 


2 


32 


0 


4.62 


' 2 


If you had it to do over again, would 
you want your son or daughter to parti- 

cinst© in thp parPPr orliir;i'f"ifSn nv^nnv^am? 
\«i^uuc III UMC uaidci cuu v^a u luii |Ji uyi dill: 

f 


1 


5 


28 


0 . 


4.44 


20 


How would you rate the enthusiasm of 
the career education program staff? , 


^ b 


4 


25 


5 


4:34 


11 


How would you rate the approaches to 
learning irt the program? 


0 • 


6 


27 


1 


4.27 


V 


How well does the program compare 
overall with past school experiences? 


0 


8 


26 


0 


4.24 


8 


What effect has the career education 
program had on helping your son or* 
daoighter form career plans? 


0 


"5 


29 


0 


4.24 


18 . 


How would you rate business and * 
community resources in the prog^ram? 


1 


Z 


26 


5 


4.17 


17 


How would you rate the general quality 
of the career education program staff? 


1 


r 
D 


21 


7 


3.96 


19 


How would you rate your overall 
relationship with the staff of the 
program? 


1 


9 


19 


5 


3.93 


14 


How often does your son or daughter 
talk to you about the program? 


4 


9 


91 


n 


/ 


9 


How much opportunity did the program^ 
proviae your son or aaugnter tor 
general learning? 


7 


6 


21 


0 


3. 71 


6 


Have you received information about 
your son*s or daughter* s progress in * 
the program? 


14 


11 


9 


0 • 


2.71 


15 


How often have ybu had any contact with 
any program staff members? 


15 


16 


* 3 


0 


. 2.47 
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felt strongly that their child a much more motivated student as a result 
of participation in the program and agreed that if the choice were to be made 
again, they would want their child in the program. These three items were 
ranked among the top four, as indicat^ on Table 3.1k 

Out of 72 responses to open-ended questions concerning positive and 
negative changes in the students (with some parents listing^re than one 
change) there were 12 references to negative change in "the students. Seven of 
these negative responses |iad to do with problems related to student organiza- 
tion of time and activities. Positive responses i niJjjdftdL^nriprovenient in 
interest in school (10), in decision-making/planning (8), inNconfidence/poise 
(8), in independence, ifiotivation, happiness (7 each)_, and in maturity (4). In 
contrast, only four respondents mentioned "changes in learning or thinking: one 
cited an increase in career awareness and three mentioned increased student 
planning for the future and fbr college. One parent felt that the program had 
not led to perceptible changes one way or another. 
^ Overall, the p|irents' responses were Targely confined to describing 
positive and negative changes in .the student^N4n the area of personal growth, 
rather than in the area of ^intellectual growth.^9(^ semester may b'e too short 
a time for observable change in thinking and learning pattern^" It is, however, 
of interest that pcirents felt they were able to note positive growth in their 
•sons and daughters in the life-skil'ls areas. 

What was parent perception of the learning progrm at FWS? 

Examination of Table 3.11 indicates that the parents as a group tended to 
rate highly the items concerning the unique learning aspects of the FWS 
program. With one exception, all items on the scale with means above 4^00 are 
related either to specialized aspects of the FWS learning program or to the 
effect of the program on the student. The group of parents also rated highly 
^ the school's ability to offer the opportunity to learn more about occupations. A 
similar statement on the opportunity fbr general learning, however, was near 
the bottom of this ranked drstribution, although the mean was still above the 
midpoint of the rating scale. 

Miat did parents see as weaknesses and strengths? 

Asked to write opinions as to the weaknesses and strengths of the FWS 
program,- parents mentioned -more strengths than weaknesses. Of a total of 102 
responses (-som^ parents gave mrfi than" one answer). 35% were concerned with 
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negative aspects of the program and 65% with positive one%. Ten parents out of 
36 did not mention any weaknesses; four parents failed to niention any positive 
qualities. ' n - 

Parent concerns about the program related^ four. areas: guidance, 
curriculum, coordination or conununi eating, and structure, E4ev^en responses 
expressed concern over lack of guidance and/or lack of communication among, 
staff and students. All these responses were* from parents whose children were 
n6w to the school this year. Twelve responses expressed concern over ' » 

curriculum. Parents of new and^returning students had comments cbncernjng 
inadequatejcurri culum'(5), poor coordination (3), and lack of ^structure (4), 
Eight parents felt students needed more adequate college preparation and 
information. Five parents expressed a need fo/'more communication between 
school and parents. 

Whefi parents were ?sked to write on strengths of the program, thejiost 
frequent response given (28) related to an aspect of student growth. Twenty 
responses emphasized the unique curriculum aspects of the EBCE program while 
18 responses supported the characteristics of the school i.tself,, (See Table 
3.12.) , * ' , 

\ 

TABLE 3.12, 

GREATEST STRENGTHS OF THE CAREER EDUCATION PROGRAM AS REPORTED B\» PARENTS 



Category 


'Characteristic Strengths 


No. of 

Responses 


Total 


Student growth 

X — 


Act independently and responsibly; 
m^e deci sions 

, Increase confidence, ability to 
deal with others 

Increase motivation 


_ 16 

4 
8 


28 


Curriculum 


Career exploration 

Experience-based work with adults, 
conmunity 


11 

9 


20 


School 

characteristics 


Lack of regimentation; less structured; 
more open 

Individualized guidance; §mall school 

1 1 


7 
11 


' 18 
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Hm did parents perceive the staff at FWS and the pdpent-staff relation- 
ships ? 

Parents -were asked to rate staff on enthusiasm and general ability. 
Although, the mean gating for staff quality would be at the "very good"-level 
enthfsiVsm Was rated even high|sr. tt was placed in the midst of the upper group, 
of ilems in Table 3.11, which may indicate that, at least for this group of ^ 
parents, staff attitude is an import?ant program element. 

Parents saw th6ir relationship with the staff as mildly positive, but they 
rated at the bottom of the list (with means below 3.00) the two items having 
to do with staff/parent communications. Sixteen parents indicated that they 
had aittended no parent meetings in this school year; fourteen had attended one 
meeting and- four attended more tHan one. Fifteen parents rated their contact 
with staff. as "almost never" or "seldom" while another 16 were at the neutral 
-''level. Only, nine parents felt tlfiey had received enouilr, 'or almost enough, 
information from-the'^staff . Most of the omitted Items on the questionnaires, « 
moreover, had to do with parent-staff ratings, indicating that parents lacked 
enough contact to feel comfortable rating staff members: It appears clear 
that the parent^ primary .source of 'information about the program and staff at 
FWS comes from'th^students rather than from direct c^)ntact wij:h the school. 

Whiah students did the parents feel would benefit most from EBCE? 
'\ Thirty-three parents provided 52 responses to -this" questionT" As Table 
3.13 indicates, parents did not see the school as'being primarily useful to 
"problem" students in need of guidance and motivation. There are only five 
-responses in that area, while 25 parents mentioned intelligence, motivation, 
self-discipline, and independence as well as other qualities associated with 
"good" students. Eleven parents saw the program as advantageous for students who 
y(Jid not respond to the regular public school program. 
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TABLE 3.13 
KIND OF STUDENT WHO BENEFITS 



I 




Mature, self-disciplined, independent 

"Npoesn't respond to structured academic high schfiol 

Wants career orientation program f 

Needs gui^dance, direction; small school,, 
not motivated 

Some, most, all students 



12 
11 
7 

5 

4 



Parent Interviews' 

Parent interviews were conducted by an outside contractor. Parents of 
^ the FWS experimental group and parents of second-year students were interviewed 
(N=25). ; X 

What were the parents' attitudes about far West Sahool? ■ . 

(See Appendix C.) Most parents (65%) had a totally positive attitude'^ 
about the Far West School, some parents had both positive and negative atti-' 
tudes (27%), and a few parents had only negative attitudes (8%). The most 
frequent positive comfients we^e that FWS offered an excellent practical pro- 
gram (23%) and that .their children liked it better than regular school (23%). 
The most frequent negative comnent^ that- there was not enough communication 
with the school, was also frequently voiced when parents were asked i.f they 
wanted more information about the school. 

How was aomunioation between students and parents affoaied? 

, Most parents (69%) said the^dent talked with them about the program at 
Far West School; only a few parents (8%) said the -student did not ta-lk about 
the program at^l . Most of the student and parent discussion about the 



program was about the. projects the student was doing and his experiences in the 
field (58%). (See Appendix C.) 

What ohanges in theiv sons and daughters had parents 'observed? 

Table 3^14 illustrates the generally positive attituW that parents 'have 
about th«-~Ear West School and thfe effect it is having on their children. They 
perceive their children as being more interested in school and working harder; 
being more responsible, iriore confident, more mature— in generaT, more motivated 
and doing, a better job than before. (See also "Appendix C.) 

^ - .> 

TABLES. 14 ' . 

PARENT INTERVIEW: POSITIVE CHANGES OBSERVED IH STUDENTS 





Percent of Parents 


Change 


Observing the Change 


♦ 


(N=26) • 


More interested in schooVnow; more involved 


85 


Working harder now; concentrating ' 


65 


More responsible now * . 


54 


Has more confidence' in self; ^more self-worth 


50 


More ma,ture/adult/grownrup 


42 


Plans to go to college now 


38 


Still not sure; changes mind about future 


31 


* • 
Goes to school regularly now; never did before 


19 


Gets homework done now 




'Seems happier now » 


15 


More motivated now , 


. ^12 


Reads a lot now" • ' - 


"8 



How do parents compare FWS with regular* high school? 

In comparing Far West Schoo^l with the regular high school,, some parents 
said that FWS was much- better all around (23^), that the student worked more 
and talked more about his work at FWS (19>6), and that the student had more 
freedom 05%). But some parents also said they did not know enough about FWS 
to compare it with regular high school (12%) and that FWS should have more 
classroom-type, teaching (8%). (See Appendix C»)" 



'Resources. 

———— ^ • . 

Resource Questionnaire 

A questionnaire was used to gather descriptive information about the ' - 
resource site, student-resource relationships, and the perceptions and 
attitudes, of the resource person (or his organization) toward EBCE. 

, In view of the complex nature of the resource ques'tionnaire and the fact 
that a good deal of time' was required to c<>mplete it* the instrument was sent 
only to resources involved in at least one Exploration or Inyestigation- (an 
interaction with one or more students taking more than 10 hours), or in more 
than one Or-ientation (an interaction of less than 10 hours). . 

The number of questionnaires sent to and completed by each resource type 
is shown in Table 3.15. Not surprisingly, reaction to the'task of completing 
a form of this complexity was "often negative, despite an extraordinary amount 

TABLE 3.15- 

^ NUMBER OF RESOURCE QUESTIONNAIRES SENT AND RECEIVED 
AND PERCENT RECEIVED FOR EACH. .OF THREE RESOURCE TYPES 





M 

Resource 


Persons; 


Resource 
Organizations 


Total 


Questionnaires 


Staff- 
Developed- 


Student- ' 
Developed 


Number sent 


25 


23 


12 


60 


Number 
returned 


. 21 


10 


5 


36 


Percent 
returned 


' 84% 




42X 


60% 



of staff time and energy spent in telephone calls and personal visits following 
the resource person's receipt of the questionnaire. The overall rate of return 
was 60% (35), though many of these respondents did not complete the 6ntire 
questionnaire. Consequently, results have Ijeen calculated on different bases. 

When the questionnaires were returned it was noted that a typical respond- 
ent had participated in the program from' four to five months. Four, however, 
had participated approximately one month, and another four had participated one 
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year or longer. , The responses were coded numerically when possible; open- • 
ended questions vyere categorized for the frequency of recurring responses; 
counts were-made for each item and appropriate percentages calculated. (The 
form of the questionnaires and the basic statistics for individual items can 
be found in Appendix C.) 

For purposes of exposition, the data are assembled in three major cate-*^ 
• gories: descriptive, program operations, and program impact. Table 3.15 in- 
cludes a breakdown of response rate for resource persons and organizations ( 
recruited by staff as opposed to recruitments by students. The respondents 
represent a diversity of professions, business, and careers in industry, educa- 
tion, and [jublid service. Most respondents are located in the vicinity of 
^Oakland-Berkeley, although several .are located in the .San Francisco area. 
Organization size^ ranges from companies employing a few-persons to those em- 
ploying more than a thousand. In the latter cases, the specific learning 
sites were usually subunits of the organizations. Table 3.16 gives the median 
number of employees in the whole organization and at learning sites for the 
three resource groups. . • • , 

' TABLE 3.16 • 

MEDIAN NUMBER OF COMPANY EMPLOYEES BY TYPE OF RESOURCE 



Type of Resource 


Number^f Employees 


^n Company 


At Learning Site 


Resource persons: 






Staf-f-developed 


16.0 


5.5 


Student-developed 


106.0 


11.0 


Resource organizations 


34.0 


29.5 



The main reasons given for program participation are: interest (8), pro- 
gram goals (6), Experiences offered (4), benefits to the resource (4), em- 
ployer request to participate (3), enjoyment-of students (2), and interest 
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Interest: 



^Prograhi 
goals 



in the FBCE approach (2). The^following are examples of statements by resource 
questionnaire respondent^: , - ^ . 

"WeVe a pjblic service agency and, of course, we're 
interested in developing a sense of such service in young 
people. Also, we feel responsibility to provide informa- 
tion and training that will lead to enlightened use of the 
environment." 

"I found out about iti^t seemed interesting; further 
information from staff 'anci students was positive; thus we 
became involved," z 

"The goals of the program are in agreement vlith many of my ' , 
own personal conclusions about educational needs for young . 
. people." 

» 

"I wanted to assist an education program that promised to 
help students make better decisions abou^: their directions 
in life and jobs," - \ 

"The head of the University of California Department^ of 
Bacteriology and Immunology had previously dealt with Far 
'West School and felt that it would be a productive expe-* 
rience." 

"To expose high school girls to role model-s and show tnem, 
what career options are available to them." 

-"The first student was quite a good volunteer worker and 
we need help. The more volunteer workers we have (up to 
^.a point), the better program we can offer." 

"It was an employer request that my company become involved, 
and I thought it would be interesting to pa^rticipate." 



Experiences 
offered: 



Aid to youth: 

Benefit to 
resource: 



Employer 
request: 



How did students spend their tijm at vesotivae sites? 

When asked about the number of hours spent with a student during a visit, 
nine of 29 respondents :(31%) reported one hour per student visit; seven respori- 
dents (24%) reported four hours per student. 

Information* reported on tjpe amount of time students engaged in activities 
is reported 'in Table 3.17. Respondents reported that the most frequent 
activity at the Orientation^ stage ^as brief observation of site-^operations; 
the next m9st frequent Activity was interaction with the resource person. 
Interaction wjth«the RP became the most freqiient activity reported at the . 
Exploration Stage. At the Investigation stage, interaction with the and 
PQrforjnance of site activities were the most frequent activities. 
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TABLE 3J7 

^FREQUENCY OF VARIOUS STUDENT ACXL^ITIES BY AMOUNT OF^J^ttE^ 



Amount of Time 



Activity 


Oripntat inn 
(0-9 hours) 


ExdI brat ion 
(10-39 hours) 


I nvesti nation 
(40+ hours) 


Weighted 
Frequency* 


Performing site 
activities 


. 9 


12 


13 


72 


Interacting 
with me 


16 


13 


13 ' 

• * 


71 


Observing site 
activities 


22 


12 


5/ 


61 • 


Interacting with 
other site 


12 


11 


9 


. -61 


personneLfJ 










Researching from 
site materials^'' 

• 


4 


12 ■ 




43 


Individual study 


3 




■ 1 6 \ 


. 39 



* Sum of .the number of Orientations- plus two times the number of 
Explorations plus three times the number of Investigations. See tpxt. 



Ifnat services were offered to the students by the resources? 

Table 3.18 identifies the frequency with which various services were 
offered by resources in" terms of the amount of time spent on edch service. The 
services most frequently offered to students during Orientation were career 
counseling and company orientation. At the Exploration *stage, the emphasis 
shifted to planning of student assignments, although career counseling and 
company orientation remained important. The Investigation stage emphasized 
training students to perform specific job-related tasks in the community and 
evaluation of individual student assignments. 



/ 
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, . -TABLE 3.18 
FREQUENCY OF SERVICES OFFERED BY AMOUNT OF TIME 







Amount of Time 


• 


Service 


Orientation 
(0-9 hours) 


Exploration 
(10-39 hours.) 


Investigation 
(40+ hours)- 


Weighted 
Frequency^^ ' ' 


Training to perfoj'm 
a specific job-related 
task in grganization 


"12 


9 


14 


72 


Company orientation 


23 j 


11 " 


. 8 


69 




19 ' 


11 


9 


68 


Evaluating individual 
students* assignments 


. 6 


9 


13 , 


63 


Planning student 
assignments 

• * 




12 


8 


59 


Personal counseling 


10 


9 


7 


49 


Tutoring in academic 
area 


8 


9 


5 


41 


Assisting students in 
•non- job-related 
assignments 


5 

<• 


3 


3 


20 



* Sum of the number of Orientations plus two tim^s the number of Explorations 
plus^tht^ee times* the number of Investigations • See text. 



How did vesourae persons assess student interest in the program? 

In response to questionnaire* items concerning student interest in the 
EBCE program or in their specific resource sites, 22 of 31 respondents indi- 
cated that students. were interested in EBCE, five indicated that students 
•were uninterested, and four felt that students were neutral. Of 32 resource' 
respondents, 17 felt that FWS students were interested in their specific sites, 
seven felt that students were not interested, and eight felt students were 
neutral. (See Appendix C for the response-frequency'data.) 



/-Tiat did resource persons see as strengths^ and weaknesses of Fac Uesv 
School? 

The jnajority of respondents focused on the school's positive aspects, 
particularly on experiences to which students had been exposed. Twelve 
respondents noted the benefit to students of being able to take part in the 
world of work, seven cited student familiarization with a variety of career 
opportunities, and six respondents felt that one of the program's greatest 
strengths was the Students' opportunity to learn responsibility. Other 
strengths listed by respondents included contributions of students to a job, 
development of new modes of education, student opportunities to work with 
highly skilled persons, a chance for students to become motivated to learn, 
provision pf on-the-job training, and provision of a fprum for students' ideas. 

Although program weaknesses identified by respondents \/ary greatly, they 
all indicate an interest in making the program m6're successful.' One weakness 
cited was the lack of organization, Xinely, a lack of structure in instruc- 
tional settings and insufficient C(kimuni cation between students and FWS. Other 
weaknesses less frequently cited indlude an inability of students to fully 
utilize their opportunities, th^ cp^t of the program, the program's neglect of 
basic skills, the fact that too few students visited the resource, staff changes 
at fWS, lack of time to be with students, and excessive evaluation requirements. 

What' were the effects of the EBCE program on organisations? 

Resource persons, asked if EBCE effected their organizations, noted 
several kinds of stutlint impact. Their experience with students affected 
^'company .training policy," according to nine (39%) of 23 respondents. Ten of 
27 (37%) respondents reported some change irt the amount of work performed by 
employees; -seven (26%) of 27 respondents noted that^BCE had an impact on the 
quality of employee work; and two {8%) of 24 residents said involveWnt with 
EBCE hhd influenced their company's hiring practices. Although fewer than half 
of the questionnaire respondents answered the question dealing with the value 
of EBCE 's.„.im'p act, those who did gave a overwhelmingly favai-a'Ble response. Only 
Qne respondent commented unfavorably on. the effect of EB£^E on the quality of 
employee work, and only two were unfavorable regarding HBCe''s influence , on ^the 
quantity of employee work. Six (75%) of eight responden\s thought the EBCE 
program had a positive impact on training procedures and etgiit (57%) of 14 
indicated a positive impact on the amount of work done: "Eiflht .(53%) of 15 
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respondents indicated a positive impact on the quality of employee work. ^ The 
remainder answering the question chose the neutral response. 

There were no negative employee .reactions to EBCE accordi.ng ,to the 
respondents. The most frequently cited benefit to regular employees was "in- 
creased awareness of youth," on which 18 (50%) of the respondents concurred. 
"Increased interest in their own work" on the part of regular employees was. 
checked by seven (19%) of the -respondents. Seven others' noted no identifiable 
beneficial effect from the presence of students. A few resourde persons 
indicated benefits such as reduced employee work loads and a higher level of 
motivation for training among regular employees. 

Do resoio'ces s^^Tport the p2<ogram? 

The resource persons are willing to support EBCE. One respondent 
indicated that he woul<! not continue to serve (because of a lack of time). ^ 
Nine persons, the majority of whom were not in decision-making positions, 
indicated that they did not know if they would ^ntinue to serve as resources. ^ 
Twenty-six people (72%) affirmed that they would'' continue serving the program. 
When asked if they would "recommend to another penson that he/she also, become 
involved with EBCE^," twenty-seven of 29 respondents (93%) Vdicated that they 
would; this further documents the support for EBCE and the lik'elihood of 
continued" participation. 

The primary reason given by respondents for continued participation in 
the program was that of helping students (six respondents). Four respondents 
indicated their organizations actually benefited from student participation. 
Other reasons less freJjuently cited included: a liking of students, a des're 
, to encourage students, approv^al of the program, beli.ef in .the program value to 
students, and opportunity to familiarize students with a certain career. 

The most frequently cited reason for respondents, recommending EBCE 
participation to others was that it would increase learning opportunities and 
experiences for, youth. Also frequently mentioned was approvaUof the program 
concept and benefits ajbcruing'to the resource organization as a result of 
participation. Asked what aspects of the program might encourage others to 
participate as RPs, respondents noted help to students, increase in student 
motivation and independence, and a reduction of crime and welfare. 

The high rate of respondent willingness to encourage further expansion of 
community participation in EBCE, coupled with the reasons cited for encouraging 
such participation, suggests two conclusions: (1) resource persons have a high 
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level of overall satisfaction witfi the EBCE concept, and (2) they^are satisfied 
with their own perceptions of their roles as implemented in EBCE, 

Respondents conveyed a strong sense of commitment to EBCE, expressing the 
desire both to strengthen communication among FWS staff, RPs, ROs, and CR^ and 
to attain a better understanding of what FWS students seek, to accuTfipTTsh at the 
learning site. ' , ' ' . . 

Midyear Interviews 

Te^lephone interviews weKe conducted by the external! evaluation contractor 
with resource persons at midyear and at the end of theJschool year. At midyear 
a sample of 28 RPs responded. The sarnple of 30 resources was chosen for 
interviewing from among those who had experienced at least one Exploration or. 
two Orientations with FWS students. TwD of these resources were not reached, 
one because of illness, the other because ^^w job had taken him from the\ 
are^i . . . " , / 

The interview was mainly concerned with first, RPs perceptions of how worth 
while' lKe experiences were to them arid to the students, and second,' the RPs 
obserA^ations of changes in the. students . In general, most RPs felt that their 
exfieriences were beneficial to the students and to themselves; many observed 
growth in the students* job knowledge and abilities. Some RPs complained 
abput lack of communication with Far West School. 

What were, the i*eactions of resource persons to FWS students? 

Most resource persons .(715S) felt the exp^riencfe was worthwhile to them, 
and a somewhat lesser number (64%) felt the experience was worthwhile to the , 
student. The most frequent positive comments were that students learned a 
lot about a resource person *s job and developed job skills (29%). that the 
student had been helpful (18X), and that*the student benefited by being on 
the" job -i^8,%). The most frequent* lie gative coroment was that the §tudent was 
not interested in the resource person's job. or. in what he had to say (14^^). 
(See Appendix C.) 

* 

Wfiat changes had resource pevsortB observed in students? 

» 

Resource persons- varied .widely in the amount of time 'they had spent with 
FWS students, ranging from just a few hours to many hours over several months. . 
Some RPs felt that their time with -the students was too short to observe a 
change (28%)-, some said that they.had observed no\ change in the student (28%), 

■ 
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while others (43%) did observe growth in the student^s job knowledge and 
abilities during the period of their contact: (Appendix C.) ^ 

In response to the general question' about ideas not covered in the 
questionnaire, some resource persons complained aljout the lack of communica'tion 
with Far West School (28%) r Some RPs also mentioned that students should co(ne 
to^the job more often or should be on some kind of schedule (21%), However,^ 
some RPs said they would like to h^ve more students (15%), and only one said 
he was dissatisfied with the Far West School program, 

Year-End Interviews , * 

^ 

A^the end of the year, a sample of 27 RPs responded to an interview more 
specific than the one at midyear. Questions conjcerned the relationships 
between the RPs and students, what the students learned f.rom^the RPs,, the RPs' 
role in students' projects the RPs* attitudes about the projects, and the ^ 
RPs' perceptions of how effectively students used. the learning experience, 
(See interview form in Appendix C.) 

I Uoiji many students were seen by BP$? 

^ Some resource persons saw several students during the past semester, but 
' ten of those RPs interviewed saw only one student (see Table 3J9)/ 

<, ^ . ■ 

TABLE 3.19 

NUMBER OF STUDENTS SEEN BY RESOURCE PERSONS • • 

DURING THE SPRING SEMESTER 
(N=27 BPs) ' 



Number of Students 


Number of 


Seen During Spring 


Resource Persons 


0 


2 


1 


10 


2 


. 4 


3 


3 


4 


3 


5 


. 2 


6 


2 


7 


0 


8 


V 
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How many students xhve seen at 'daotx level df involvement? 

Only about half of the resource persons got beyond Orientation relation- 
ships with the students- (see Table 3.20). For that reason, many RPs were not 
able to respond to questions about students' projects in the more* intense 
levels of participation. 



TABLE "3.20 

NUMBER OF RESOURCE PERSONS 
INVOLVED AT EACH LEVEL 
(N=27 RPs) 



t 

RP 


1 s 

Kevel oT^st Student Involvement 
^"T^complished " ^ • 


Orientation 


Exploration 


Investigation 


Involved 

Not involved 
Don't know 

Not appl icable 


3 
3 
•4 


^.y n 

16 
0 
0 


3 
24 
0 

' "0 



Wzat was the RP opini'on of the learning experience? \ 

The resource persons made fiBny diverse conments about what Ihuy thought 
students had learned from their^RP experiences. Of 22 RPs re'^mling to what 
students learned,, 14^e1t students had learned and had benefited from their 
experiences. Only oneS^P made a negative statement. (Se^vJCable 3.21.) 

Was appropriate., use nb^of learning erperienoe 'at resowoe site? 

Of- 19 resource" persons wh(K|;es ponded Ifo th'is question, 11 made positive 
comments. The thre^^^^feive c5mmer>^?>«^:g^ISlnly concerned with the stu- 

, dents' failure to^e prompJS or keep appointmentsT the unclassified consents 
were mainly concerned wi'fh a l.ack of conmunication between students and RPs. 

. (See Tabl^ 3.21.) ' ' , 



l)fhat was HP evaluation of ^ student projects? 

Only 15 resource persons responded to 'the question about the projicts* 
worth but 12 of the responses were positive; again only one made a negative 
comment. Ten of 17 RPs who responded made positive comments about students 
giving them infprmation about projects. Resource ^persons were less positive 
when evaluating the students* ability to seek their help in planning, conduct- 
ing, and evaluating projects. Fewer than half of the resource persons who re- 
sponded made positive conments about these RP roles in student projects. Re- 
source persons were most negative about the inadequacy of the school *s communi- 
cation about students* projects. Of 24 RPs who responded to this question, ip . 
gave negative comments and seven gave positive comments. (See Table 3.21.) 

Student, Parent, and Resource Comno J Ratings ^ ' 

^ How do students^ parent Sy and vesoiwoes rate the effectiveness of PWS 
student learning? ♦ ^ . 

At midyear, students werfe^ asked to rate the importance and effectiveness- 
of FWS in accomplishing learning in each of 15 areas. /Resources, and parents ^ 
were asked to complete an identical questionnviire item, rating each of 15 stu- 
dent learning, areas on a 5-point scale: , (1 = not effective; 5 = highly effec- 
tive).* ' ■ ^ 

Table 3.22 presents the means for student ratings (N = 55) with the 15 
learning areas re-ordered by mean for the ratings on program effectiveness. The 
15 means are fairly close together. On >the 5-point scaTe, all of them are above 
the midpoint, with the lowest at 3.:|8'and the' highest at 4.49. "The overall mean 
on effectiveness for the 15 items is 3.99' . , 

In terms of students' ratings, the FWS learning areas percewed as being 
" relatively most effective are those areas that create awareness of career op- 
portunities, and that help students assume responsibility for tj/emselves, have 
a positive attitude toward learning, make decisions and folTow through, commu- 
nicate with others in a mature way, and work with others. Conversely, the FWS 
learning areas §een as relxitively least effective are those areas that prepare 
students to perform basic academic skills,. to perform" specifi' occupational^ 
skills, to evaluate- their own work, to have a positive attitude toward work, 
and to be punctual and organize time. ^ ^^^^ 

*The item is the-final question "on each of the si te'-common'' instruments ; see 
ADBendix C. ' ^ 



TABLE 3.21 

TABULATION OF RESULTS OF QUESTIONS ASKED 
IN .THE END-OF-YEAR RESOURCE ^INTERVIEW 
(N=27 RPs) 





— " ■ " ' [ 

Resource Person Response 


Question 

• 


Positive 


Negative 


Do ■• 
• Not , 
Know * 


Question 

Not 
Applicable 


What was the RP*s opinion of. 

Lite ICQllllll^ CA|-^d ICIlVifC* 


14 


1 


■ • 7 


5 


Did the stuclent make 
appropriate Vise of his 

PXDpri pnrp ( ^ ^ 


« 

11 


3 




8 ' • 


What was the RP's evaluation 
of student projects? ^ 


• 

12 


■ 1 


2 


12 


Did the student inform the 
RP about his project?^ 


10 • 


. 2 


5 


10 


Did the student seek help 
from the RP in^planning^ his 
project^ • ^ 


8 


8 


1 


10 


di4 the student seek advice 
from the RP in completing 
his project? 


8 


8 


1 

) 


10 


Did the student ask the RP 
to evaluate his project when 
completed? 


7 


7 


2 


11 


Did FWS provide the RP with 
feedback on tjj^chobl *s 
reaction to the project? 


^7 


13 


4< 


3 
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TABLE- 3.22 - 

FWS STUDENT RATINGS OF PROGRAM EFFECTIVENESS 
• , AND IMPORTANCE OF 15 STUDtNT LEARNING AREAS 

{N=55T . 



Item 


Mean 


1 

Mean 


Ff f prt i \/pnPQ<i 


iinpur LuiiLc 


Be, aware of more career opportunities 


4.49 


4.48 


Assume responsibility for themselves 


4.35 


■ 4.82 


Have a positive* attitude toward learning 


4,22 


4.50 


Make decisions and follow through- 


4.18 


4.54 


Communicate with others in a mature way 


4.14 


4.42 


Work with others 


4.12 


4.14 


Improve interpersonal skills 


4.04 


4.28 


Think throuah and ^nlvp nrnhlpm<: 


4.00 


4.56 


"^Have a positive attitude toward self ' 


3.96 


4.65 


Prepare for further education 


3.96 


4.42 


Be punctual and organize their time 


3.90 


■ 4.42 


Have a positive attitude toward work 


3.75 


4.31 


Evaluate their own work 


3.73 


4.00 


Perform specific occupational skills 
Perform basic academic skills 


3.67 


3.86 


3.38 


3.98 



Table 3.23 presents the means for parent responses to the above question. 
Parents are generally favorable in their ratings of the effectiveness of the 
FWS program in all 15 areas. .ATI ratings' means are above 'the midpoint cf the 
5-poi-nt scale, with a range from 3.44 to 4.47. The five areas in which the 
program Is, seen as relatively most effective "are those areas that help students 
develop positive self-attitude, become aware of more career opportunities, as- 
sume responsibility, communicate in a mature way, and have a positive attitude 
toward work. The five areas in which the program is seen as being relatively 
least effective are those areas that help students perform basic academic skills, 
perform specific occupational ^..kills, prepare for further education, to be punctual 
and adequately organize time, and improve interpersc^al and social skills. 

«- i . ^ • 



Parents place the greatest importance on assuming responsibility (4.97 on a 
5-point scaleK making decisions and following through, having a positive atti- 
tude toward self, thinking through and solving problems, and.having a positive 
attitude toward learning. The five areas of relatively least importance for • 
parents are performing, specific occupational skills, improving interpersonal 
and social skills, being aware of more career opportunities, evaluating theirs 
(students) own work, and preparing for future education. We need to stress 
the word relative: .the lowest mean rating given by parents is a 4.00. In other 
words, parents perceive all 15 areas to be of considerable importance. 



TABLE 3.23 

« * / 

• c 

FWS PARENT RATINGS OF PROGRAM EFFECTIVENESS 
AND IMPORTANCE OF 15 STUDENT LEARNING AREAS 

(N=34) 



Item 


r^eai^ 


«4 

Mean 


Effectiveness 


Importance 


Have a positive attitude toward -self 


4.47 


4.91 


Assume responsibility- for themselves 


. 4.47 


4.97 


Have a positive attitude toward work 


4.47 . 


4.82 


Be aware of more career opportunities 


4.41 


4.47 


Communicate with others in a mature way 


4.29 

« 


4.82 


Think through and solve problems 


4.12 


4.88" 


Make decisions and follow through 


4.15 


4.97 


Have a positive attitode toward learning 


4.15 


4:88 


Evaluate theiiiJ^wn work 


4.15 


4.61 


Work with others 


•"4.12 


4.68 


Improve inl^er personal and social skills 


• 4.06 


4.41, 


Be punctual and organize their time i- 


3.82 


4.85 


Prepare for further education ' 


3.79 * 


4.62*" 


Perform specific occupational skills 


3.75 


4.00- 


Perform basic academic skills 


3.44 


4.70 



ERIC 



r 



79 



The FWS program is seen by parents as being most deficient in providing 
for performance in basic academic skills (4.70 in importance vs* 3,44 in 
effectiveness) and in being punctual and organizing time (4,85 vs, 3'82). . 
Conversely, the least discrepancies occur in the area of making students more 
aware of career opportunitie;s (4,47 in importance vs, 4,41 in effectiveness) 
and in preparing them to perform, specif ic occupational skills (4,00 vs. 3,75), 

Thirty-six resources completed the questionnaire (N = 36)* Unlike the 
student and parent data, however,- the resource data were marked by a relatively 
high incidence of nonresponse, parti culcirly with respect to the ratings of 
prog ram' effectiveness* For some items nearly. half of the respondents failed 

.to. give a rating, apparently because they felt they lacked sufficient experi- 
ence (in terms of amount of time in the program and number of students they , 
had worked with), had only a limited view of the entire program, or were un- 
willing to cope with^this complicated item after having already gone through 
the complex and lengthy questionnaire,. • ' 

Table 3»24 indicates that the resource people see the FWS prograrn as being 
relatively mo^t effective in prepa»:ir\g s^tudents to work with others, be aware 
of more career opportunities, have a positive attitude toward learning, have 
a positive attitude toward worj<> and assume responsibility for themeselves. 
The FWS prbgram is^ seen as being relatively least effective in preparing stu- 
dents to be punctual and organize their, work, perform specific occupational 
skills, evaluate their own work, have positive attitude toward self, and per- 
form basic academic skills. None of/the 15 areas received mean ratings lower 
than the midpoint of the 5-point scale in terms of effectiveness* The; lowest 
mean was 3,10; the highest was 3,86^ 

In terms t)f importance, the resources rated the following five areas as 
the highest: having a positive attitude toward learning, having a positive 
attitude toward work, having a positive attitude toward self, being punctual 
and organizing their students* time, and working with others. The five areas 

*with relatively low importance ratings* means are: performing specific occu- 
pational skills, performing basic academic skills, preparing for further 
education, improving interpersonal and social skills, and being aware of more 

^career opportunities, - ' , 

I 
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TAkE 3.24 

- • > - .<■ ' . 

RATINGS BY FWS RESOURCES\(ROs*AND RPs) OF PROGRAM EFFECTIVENESS 
AND IMPORTANCE-OF 15 STUDENT LEARNlTiG AREAS ' 
. (N=36) 



Item 



Work with others 

Be aware of more career opportunities 
Have a positive attitude; toward learning 
Have a positive attitude toward work 
As^urfi^ responsibility tor themselves 
Improve interpersonal and social skills" 
Prepare for further education 
Communicate with others in a mature way 
Think through and solve problems ■ 
Make decisions and follow through 
Perform bas'ic academic skills 
Have a positive attitude toward self .„ 
■Evaluate "their own work ' 
Perform specific occupational skills 
Be punctual and organize their work 



Effectiveness 


Importance 


Mpan 


N 


ncaii 




3.86 


22 


4.58 


31 


3.77 


22 ' 


4.23 


31 


3.70 


'20 


4.81 


31 


3.68 


• 19 


4.77 


31 


3.67 


21 


4.57 


30 


3.58 


19 


4.16 


31 


3.58 


19 


4;16 


31 


3.50 


22 


4.57 


30 


3.43 


21 


4.48 


31 


3.4!* 


21 


4.48 


31 


3.42 


18 ■ 


3.97 


30 


3-. 41 


22 


4.68 


31 


3.55 


17 


4.35 


31 • 


3.23 


22 


3.77 ■ 


3J 


3.10 


20 


4.63 


32 



Agreement in Effectivp ness Ratings Between Parents and Resources 

.In comparing ratings of parents and resources on effectiveness of the 15 
learning areas, several points stand, out:, - ; . 

1. 



2. 
3. 



IZ ^^InflTl ^""^^^ ''^^^^ °^ tfie average above 

the midpoint between "not effecfive" and "highly effective;'' 

for every area, parent ratings were higher than resource ratings; 
the two. groups agreed on three of the five areas rated most ef- ' 
It^d'^V 4. ?^ "^''^ opportunities, have a positive 

.^attitude toward work, and assume .responsibility for themselves; and 
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4. the two groups agreed on three of the five areas rated as least 
effective: |:ierform Specific occupational skills, be punctual and 
organize their work, and perform basic academic skills. 

Agreement in Effecti-veness Ratings Among Parents, Resources, and Students . 

The four items receiving the highest overall rating of effectiveness (by 
students, parents, and re'sources) are: be aware of more career opportunities,' 
assume responsibility for themselves, communicate with others in a mature way, 
and have, a positive attitude toward learning. Students rated all these items - 
among the top five^n effectiveness; .pa^rents and resources rated three of these 
items amohg the top five. .The, four items receiving the' lowest ^overall rating 
of effectiveness are: perform basic skills, perform specific occupational 
skills', be punctual' and organize their time, and evaluate their own work.. Both 
stgdents and resources rated these items as among the five lowest in effective- 
ness; parents rated three of these items among the lowest five. • Table 3,25 
presents a summary of the rankings and mean values of these i^tems. , 



* * 
TABLE 3.25 

STUDENT LEARI^NG AREAS RANKED HIGHEST AND LOWEST IN EFFECTIVENESS 



t 

ITEM 


Students 


■ Parents 


> Resources 


Ranking 


Mean 


Ranking 


Mean 


Ranking 


Kean 


Be^ away*e of more career 
opportunities 




. 4.49 


4 


4.41 


2 


' 3.77 


Assume responsibility for 
themselves 


2 


4.35 


2 i 


* 4. -47 


,> 5 


3.6/ 


Communicate with others in 
a mature way 


5 


4.14 


5 • 


. 4. "29 


8^ 


3^.50 


Have a Dositive attitude 
towa^^" learning 


■ 3 


4.22 


■8 


■ 4.15. 


3 


3.70 


Perform basic academic skills 


15 ' 


3.38 


15 


3.44 


11 


3.42 


Perform specific dccupationalv 
skills 


14 


3.67 


14 


*' 3.75 


14 


3.23 


Be punctual and organize 
• their time » ^ 


n 


3.90 


* 

12 


3.82 


la ' 


3.10 


Evaluate their own'^^^ork 


13 


3.73 


9 


4.15" 


. 13 


3.55 



fC7 ■ 82 , 



STUDENT OUTCOMES • , - . 

• ' - » . 

Self-rdevelopment / • • . , 

Is the Ft/S individualized approach able bo assist those needing help in' 
self-expression? (Initial Planning Fom^ SPPS) . , 

During initial diagnosis, students were given a checklist of seven school- 
related areas in which they could request help. Eleven of the 35 entering stu- 
dents stated that they would likB extra help in '"expressing myself.'* At the 
end of the school year, aTl students were asked to rate the helpfulness of the 
seven areas of the program^on a 3-poir>t scale. Table 3.26 shows" that ten of 
the\t students mentioned above rated the program as "very helpful" in improv- 
ing self-expres,sion; the otheV student rated the program as "somewhat helpful" 
in this reja^Fd. * , 



TABLE 3.26 

DISTRIBUTION OF HELPFULNESS OF FWS- FOR THOSE WHO 
REQUESTED HELP IN VARIOUS AREAS « 



< 


.FWS Bhtering, GjfOup.pBC (N=35) ' 


'Area of 
Needed Help 


Asked 


Program Judgmertt 


For 
Help 


Not 
Helpful 


Sonnewhat 
Helpful 


Ver^ 
Helpful 


Reading 


5 ■ 


0 • 


5 


0 


Writing 


. 7 


1 


3 


3 


Mathematics 


15 


4 ' 


. 9 


■ 2 


' Self-expression 


n . 


0 


" 1 


• 11 


Meeting/ dealing 
with people 


15 • 


y 

1 


2 


12 


Study habits 


13 


1 


6 . 


6 ■ 


He a 1th/ fitness • 


6 


1 


3 


' 2 
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Dii FWS students iivpvove in self- development skills? tSPPS) ^ 

■ ' ■ ■ \ * 

To" answer thi^ question, FWS and comparison students were aslcecL at the\end 
of the year to indicate their impressions of their school's helpfulness in a 
variety of self-development areas': self-expression, s*elf-understanding, study 
habits, and health/fitness. Data are s^nmarized in Tab.les 5,27 andx3.28; the 
number of points on the scale for each question is indicated in the tables. 
These tables present the Krusl<al-Wallis H statistics for comparison of the ex- 
perimental group ^versus the control group. Descriptive statistics for the RJS 
entering students and the OPS r^resentative ^roup are also* included for corro- 
boVcitive^ purposes, but K^stati^tics are not presented for this comparison. All 
t|;ie H values have" one degree of free'dom, associated with them, and are distribulfed 
as Chi-square variates^for compa^son of randomized groups. The probability 
level of the Chi-square value given a true null-hypothesis is-also given in the 
tables. It should be noted, i^i connection wHh the' tables; that H does riot re-^ 
fer diVectly to the mean di ffepences shown but to the sum of ranks^ for each 
group calculated by treating the response categories as falling on an ordinal 
^cale. All responses *in ci category are considered, equivalent. 

The data for the 'first two iteiris in Table 3,27 provide self-report evidence 
on the schooT'S, effectiveness in achieving its goals to further student self- 
' expression and self-understanding,* The evidence*supports Ihe hypothesis that 
FWL-EBCE is effective in achieving its goals of aiding students in learning 
to understand and express. themsel ves, * The resufts are consistent across 9II ^ 
comparisons. - ' * . 

Table's. 28 shows that on the iteiil "health and fitneiss," the means' for the 
FWS" experj mental group.'ancl the PWS entering group fal] toward the "not helpful" 
end of the scale, along with the control group, whereas the OPS representative 
group'falla toward the "very helpful" end of the.scale. Th^ difference shown in 
'the- experimental -control- comparison is, however, not significant. Where study 
habits are concerned, the students in the' experimental group saw the program as 
more helpful than 'those in the control grpup. 



• . J 

items "get along with others" and "nieefing and dealing wiih others" shown on 

the table will be discussed under interpersdnal skills i,n the text.. " 
' " . ' ' . . 
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'table 3.^7 

STATISTICS FOR FOUR GROUPS -ON SELF-REPORTS OF HELP. IN FOUR AREAS 



c 



» • . Item • ^ 


Group 


FWS 
Experi- 
mental 


op's? 

Control 


FWS 
Entering 


OPS * 

Represent- V 
ati ve. 


Sc4iool helped in ' Mean * 
expressing myself. 

(3- point scale;'- . . 

i = stxon^ly agree") ' ^^ y 


2.58 
.51' 
. 12-' 


1.92 . 
■ .79 

^ 

12 , 


^2.74 
.45. - 

34 


2.^17* 
.72 • 

-23 : 


4. 52- 
.05 > p 






School helped me^bet^feer' Mean 

understand myself. 

\ ' SD 

(^-point scale; 

4 ^= strongly agree) ' ^ 

H* 


3.00 
.74 " 
12 


2.17 
.58 
12 


3.15 

74 
34 


2.63 
.88 . 
24 


8.78 - 

* 

.005 N p 




School helped me aet ' M^An 
along with others. - 

(4- point scale; ^ ' 
4 = strongly "agree) ^ 

H* 


3.00 
.60 

12 - 


2.09 
.83 
11 


3.00 
.65 

^ h 


2.65 
. .83 ' 

.23 


6.52 
.025 > p 




School helped me in meeting Mean 
and dealing with people.". 

(3- point scale; 

3 = very helpful) ^ ' ' ' ^ 


' 2.59. 
.48 

13 . . 


. 2.08 
.90 


'l.ll 

' :49 ; 

i .35. 


2.26 
' ..62 
23 




.3.22 
' ' .10 > p 

? ' 





* H is the Krusk&l-Wallis test statistic corrected for ties. . * 
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or , 



jmiE 3.28 



STATISTICS FOR FOUR GROUPS ON SELF-REPORTS 
OF' HELP RECEIVED IN STUDY HABITS AND HEALTH AND FITNESS 



* 

Item i> 

3 = Very Helpful) , 


Group 


FWS * 
Experimental^ 


, OPS 
Control 


FWS . 
Entering 


OPS 

.Representative 


School helped Mean 
my study ' . 
habits. ■ 
.V ^ N • 

• 


2.23 ■ 
''.60 

13'.. 


' — : 

1.42 
:67 . 
12 


2.14 
.73 
35 ■ 


' 2.25 

.79 -'i ' 
24 


' 7.91 
; ' . ./005 > p 






School helped Mean 
my health and "„ ^ 
fitness. ^ 
N" 

H* 


1.92 . 
.67 

/ • 12 


1.75 . 
.87 V 
12 


1.94 
.69 ■ 
34 


2.48 
.68 
"21 


\^ 0;42 

7 

p > .10 







is the Kruskal-Wallns test statistic corrected for ties.^ 

How have student^' attitudes about themse'bves heen ^affected by school this , 
year? (Student Intewi^ew) * * 

In the interview, more FWS students (81%> tj^an control students (57^) felt 
they hati learned something about expressing themselves^ in the past semeVter. 
The statement "I am able to express myself better on a one-to-one basis" was 
made by some FWS students (19%), but by fewer control^tudents (7%). (See Ap- 
pendix C. 

Most FWS students (94%) and/control students (85%)' felt they had learned 
something*" more' about themselves in the past semester. But the groups differed 
on .the reasons for learning more about themselves: the- reason "I had to-think 
on my own" was made by most FWS students ,(69%), but by only a few control stu-, 
dents (25%). ''The most common reason given by control students (33%) was "I 
learned to be more responsible," also given by 38% of FWS students (see Appen- 
dix C.) ' 
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Have FWS students become more^^^aative learners'' as shown by their ex- 
pressed interests? (SPPS) « * • ' 

Ajoal of the FWS program is to produce students': .Who are "active learn- ; 
• ers." Such students, when presented with a list^of activities, can be §xpected^ 
to indicate more^likes and^fe^er dislikes in May than they did "in September."^ 
ft is felt that if^the program is successful, the students will be more njpti; 
vated, more enthusiastic about the world around them. ' .. ' * 

To investigate this question, FWS^tudents were asked to indicate the*c 
I'ikes and dislikes for 18 interest ar§as'. Fof= each item they could make one 
of three choices: - like, dislike, or no preference. This question w^as asked 
of all students at the start of the- school year .(pre) and at'the end of the ' 
school year (post), ma)(ing it possible to compar.6 changes oVer time for the 
Far'West School group. \ For thi-s analysis, only. the 35 entering students (Group/ 
OBC) were- considered. • . " ' ' 

Ta^le 3.29 shows the changes i,n the FWS entering group from^ re to post.' 
FWS students shcJwed an increased percent in the "like" category for 16 out oF, * 
the-^l^S items. On n-ine it-ems -the increase was at least 10%. These, activities 
tend to be ones encouraged by the FWS program: The data indicate that fWS 
students showed more interest in thjs group of activities- iriMay ttian they did 
in September and that the items on which they showed the most change are re.- • 
lated to activities within the, FWS program-. ^ 

V 

Do FWS students see themselves as'ahanging positively as a result of 
theii* school experiences? (SPPS) 

• • ■ - 0 «. * . 

FWS students and OPS students were asked during post- testing to "nam^ 

three ways that you have change.d as a result of your school- experienQq$^"'' (. 
Five major areas of positive change weV-e identified- from the responses,. The 
first, and largest. Was "self- growth^" which encompassed seven different re- 
sponse categories such as "more sure of self" and "more responsible." Other 
major change areas ,^ "career/work,", "learning/a'bademic/' "interpersonal," an"*^*' 
"future planning," were each subdivided into two response categories. Negalh've 
changes and responses of "no charrgV' were also recorded. Three responses were 
cdded for each student where the -data were complete. Table 3.30 indicates for' 
the FWS -experimental group and the OPS control group the number of changes, re- 
ported by each, student. It can be seen^that the groups' averaged; abqut^two 
changes per student * 

\ ' ' ' 
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. ; . TABLE 3.29 

CHANGES FROM PRE TO PO^T IN INTEREST OF 
FWS ENTERING STUDENTS RANKED BY CHANGES IN ^'LIKE" CATEGORY 

(N = 35) ^ ' 



Category 



• 

Interest 


Like 


Dislike 


* No. Response 




Pre 

% 


Post 

% 


Change 

'% 


Pre 

% 


Post 

% 


Change 
% . 


Pre 

% 


Post 

% 


Playing games ) 


35 


'ei 


26' 


38 


18 


20 


27 


21 


Doing activities 
at home 




63 


23 


32 


15 


17 


28 


22 


Read^'n^ 


60 


78 


18 


27 


12 


1 5 


1 3 


It) 


Working alone 


• 41 

f 


57 


16 


31 


20 


11 


28 


23 


Doing a research 
proje'ct 


38 


■ 54 


16 


32 


15 


17 


30 


31 


Moving around a lot 


58 


71 ' 


13 


17 


15 


02 


25- 


J4 


'Taking things apart 


38 


49 


11 


34 


31 


03 


28 . 


20 


Deskwork 


17 


29 


11 


63 


66 


03 


20 


05 


Observing 


66 


76 


10 


11 


12 


01 


23 


12 


Takthg notes 


17 


21 


04 


60 


59 


01 


23 


20- 


Listening 


69 


72 


03 


09 


14 


05 


22 


1-4 


Selling/persuading 


31 


34 


03 


49 


40 


09 


20 


26 


* Working with hands 


^4 


67 


03 


09 


15 


06 


- 27 


18 


. Discussing- 


&9 


71 


'02 


12 


09 


03 


19 


20 


Sitting 


29 . 


31 


02. 


57 


46 


11 


14 


23^ 


Making things 


■ 68 


69 


01 


09 


17 


08 


. 23 


14 • 


•Interviewing 


46 


41 


-05 


37 • 


31 


06 


17 


28 


* Serving 'people 


35 


29 


-06 


46 


47 


01 


19 


24 



-TTT ^ 
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TABLE 3.30 



"NUMBER OF CHANGES MENTIONED BY, THE FWS EXPERIMENTAL ■ 
AND OPS control' GROUPS IN RESPONSE TO THEvCHANGE QUESTION 



Group 


Number of Responses Per Student 


Total- 


0 


•1 


2 


, 3 


Responses 


FWS Experimental (N=13) 


1 


2 


■ 4 


6 ' 


28 ;■ 


OPS Control (N=12) 


0 




4 


. . 4. . 


24 _ 



Table 3.31 Summarizes the changes mentioned by the student grouR|^. Per- 
cents used. in this table 'are percents of the total response^ for that group. Be- 
cause students. gave varying numbers of responses, the data are not equaljy repre- 
sentative of all students. ; ' ' . 

It can be see^i from Table 3.31 that the experimental group exceeded^ the con- 
trol group in percents for self- growth, career/ work, and interpersonal skills 
white the Qontuol group had a higher percentage of responses in. the area of ^ 
learning/ac-ademic- All responses listed for the experimenter group were posi- 
tive in tone,' while 17% of the^control group .responses were in the nega- 
tive/no change category. The data imply thaSt FWS students.-pl ace "more emphasis 
on self-growth; OPS students see themselves as haviba made relatively more 
changes in school attitude and school achi,evement;. / " ^ \ 

Do FUS students repoPt more Hgnifio<mtlbhool-r>3tated changes them stu- 
dents at traditional eduaatimal institutions?' , (SPP?) 

.' The "change" question described in the', preceding section was analyzed for 
^the -quality of the student's total statement. It was ^elt that there was.-a no- 
ticeable range in the 'overall significance of the student's statement that was 
lost when each change was considered separately -by content category. To capture 
this overall quality or "breadth" of the statement each student's response was ^ 
rated for significance of change.. , . . . 

Significance was determined by use of the following criteria; 

1. increased insight into personal, career, or educational growth and ^ 
development; ' ~ L 
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- TABLE 3.31 

'S\i\Wm OF SCHOOL-RELATED CHANGES MENTIONEP B.Y STUDENTS* 



♦ • 



Area of Change 



FWS • 
Experimental 
. N=13 • 



% 



OPS 
Control 
N=12 



% 



FWS 
Entering 
N=35 



% 



■ ops 

Representative 
N^24. 



Sel,f-growth 

Career/work 

Learning/academic 

Interpersonal 

Tuture planning 

Total negative/ 
no change 



12 
3 
3 
9 
1 



43 
11 
11 
32 
4 

0 



6 
0 
7 

5' 
2 



0 
29 
2.1 

8 

17 



31 
10 
11 
1.6 
5 



41 
13 
14 
21 
6 



18 
1 

15 

'l2 
3 



33 
2 
28 
22 
6 



TOTAL 



28 



100 



24 



100 



76 



100 



54 



100 



i 

* Students Hst.ed from one to three "changes," so frequencies are greater 
than N. Percents represent percent of total changes of each group. 



2. increased planning for the future; and 

3. breadth and richness of statement, i.e., the extent to which the 
statement covers broad areas of change--either in terms of number" 
of different areas mentioned (career, education, personal growth) ' 
oY the importance of the changes mentioned within these areas. 

Taking the above criteria into 4:0ns i deration, each response was {rated "in 
the blind" using the following scale: 

1 = No change, or negative change 

2 = Little change ^ 
'3 = Some -significant change 

4 = Significant change 
.5 = Very significant change 

^ An analysis of the coding procedures and the interrater reliability is in- 
cluded in Appendix C. The actual responses given by FWS and OPS students, ar- 
ranged by rating levels, are also included in Appendix C. 
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table 3/32 shows the distribution of responses on the significance of 
. thange rating. Table 3*33 indicates that there is no significant difference' 
between the experimental and control groups on this measure, although the*mean - 
for the experimental group is higher. Examination of tiiese tables' plus the . 
groups of actual responses in Appendix C shows that students in the traditional 
educational •sfettinq are more likely to see the ways vthey have chariged as re- 
lated to getting along better in the school setting, adjusting to the demands • 
of the traditional school in tenpis of mastering currictrhum, entering into so- " 
cial and extraco^rricular events, and showing socially approved behavior,* Al- 
• thoucjh FWS*students also mentiorf these topics, they a/l more concerned with in^^ , 
ner growth, getting along with a variety of people, and extending the boundaries 
of their interests and knowledge. 









^ / 

1 " 










TABLE 3.32 




V 


^ ^ DISTRrBUTlON OF SCHOOL- W ED CHANGES MENTIONED BY FWS AND OPS GROUPS 


.V Significance 
' .of Cljange ^ 

• 


Rating 


FWS y- 
ExperirngA-tat 
■ N=13 


OPS . 
Control 

->* — / 


FWS . 
Entering 
, N=35 

% 


OPS 

Representative 
N=24 

% 


No change or 
negative change 

Little change 


1 - 
2 


0 
•31 


25 
33 - 


9 

20 


9 

48 • 

^ * 


« , 

Some significant 
change 

/ 

Significant 
change 

V.ery significant 
^ chaTigey 

No response ^ 


3. 

4 • 


31 


33 
0 


23 

* 

17 


13 




31 
• 8 


8 

— ^ 


26 
6 


9 

■ 4 


« • • 


















♦ / 




> 
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TABLE 3.33 



.STATISTICS FOR FOUR GROUPS ON THE SIGNIFICANCE-OF-£HANGE RATING ' 



Significance 
of .Change 


Experimental \ 


OPS 
Control 


' FWS 
Entering 


^OPS 
Representative 


Mean 


■3.33 ] 


\ 2.33 


3,33 - 


2.74 


SD 


1.30 


1.15 ■ • 


1.34 


• 1.18 


'N • 


■ 12 


12, 


33 


23 


H* 


3,27 
p > . 1 0 





* H TS the Kruskal-Wallis jtest statistic corrected for ties. 

^ ' ' i. ^ - : / . 

It can of CQurse be assljme,d ^that the FWS students are well aware of the 
differences io goals hnd object'iyWs af the FW? program as compared to a regular 
high schoo.1. To 'a certain extenf; their responses may reflfect.what they see as 
important in the program rathej* jtlian -repr'esenting gn independent estimate of 
change. In th,is event, the prpai^am appears to have/beerl very successful in im- 
parting to th^ students a new arid different set of stajidards for judging their 
school-relajed growth: \ 

• Do students^ LC$ see them:<zs ciianging positively as a result of their 
school expeinences? (Student Change Scales) 

The content analySjis of stli(tent responses to the SPPS "change" question 
was discussed in the sections above; From this analysis were derived 1^4 cate- 
gories in which the' students 'peif^ceived themselves as changgng. Each learning 
coordinator was asked^to rate thk ^legree of change he perceived in his students 
or^each of these 14 categories, l^he alternatives for ratings*were "negative," 
"none," "little," "some," and "much,V' with an option "no judgment." 

The ratings were assigned scoring values of 'l through 5 (1 = "negative"), 
Jntercorr^latlons of ratings in the 14 areas were very high: stuCients perceived 
by LCs as changing in one category were perceived as- changing ov^r^the others 
('i.e., ther^ appears to be a halo effect). 
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■ The categories were rankea on the basis of mean ratings for FWS enter- • 
ing students (N=35). Ranks, means, and standard deviations for each category 
are giv'en in Table 3.34.. Only two .category liieans were below 4.0 (the value of 



TABLE 3.34 

STUDENT CHANGE SCaI^S RANKS AND pCRIPTIVE STATISTICS 
BASED ON LC RATINGS OF FWS ENTERING STUDENTS 



f Ghange Category 

Self-con fi'tiencei. ' w. 

Aniount and depth of contact 
with adults 

Attitudes, and interest in 
current school and learning 

Maturi'ty 

Self-knowledge/understanding ■ 

Abilit/' to relate to others; 
capability for self-expression 

Inrdependence* 

MotjJrtH^i on . 

Responsibility 

-Knowledge about "specafic 
careers/ jobs/behavi or^. 

Ability to solve problems, to 
make decisions, to cope.'^o plan .] 

Knowledge of and attitudes about 
careerS/world^of wprk (gdn.eral) 

Development of future goals 
and plans . " 

Academic knowledge ^ 
(speoific ana general) 



" N 


Rank ' 


Mean 


Standard 
Deviation 


34 


1 ^ 


4.53 


.70 . 


35 


2 

1 


-4.46 


.73 


35 


3 • 


4.43* 


.84 ^ 


35 


* 

4 • 


4.40 


. 76 


•35 


6 


4,31 


.75 


35 


t « 


4.31 


.82 > 


35 


; 1 

' 6 


4.31 


.85 


■ 35 


' 1 ^ 


4.26 . 


.77 


35 


9 


4.20 


.-89 


. 35 


10 ■ 


4.06 


.71 


35 




4.03 


.91 ' 


35 


12 


'\.00 


.79 


35 


13 


■3.94 ' 


.92 


I* 32 


14 


3.81 


.92 . 
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"some" positive change); the lower of these two' was -3.81. This implies -that 
the LCs saw the group of students as'changing positively in aJl areas. It 
■must; be recognized that the LCs' ratings are probably inherently biased because 
of their direct and heavy 'involvement with students. 

Interpersonal S kills . . ' ' m 
* 

Uoesm FWS individualised approach assist those asking for help in de- 
veloping interpersonal skills? (Initial Planning Fom, SPPS) 

At the time of entry- into the school, many students felt a need for help 
in the interpersonal area.". Fifteen out of the 35 entering students indicated 
during initial diagnosis, that they would "like to have some extra help." in 
"meeting and dealing with people." At the end of the school year, all' stu- 
dents were presented with a list of-program areas and asked to rate. on a 3- • , 
point scale how helpful the program had been to them. Table 3.26. page 83 
shows that of the 15 students who had requested- help in the interpersonal area. 
12 felt that the program had been "very helpful," while two said that it was 
"somewhat helpful," and one felt that it had not been helpful. 

'^dents? 7sPPsf^ effective in 'fuvtheHng the interpersonal Mis of stu- 

■ The last two items of Table 3.27, pa^e 85 . provide self-report data on 
this question. The statistical results indicate that FWS students see their 
program as more effective tffan regular school programs in developing inter- 
personal skills. 

1 

How have students ' attitudes about their relationships with adults been 
affected? (Student Interi>ieio) 

^ 'More FWS students (75%) than Qontrol students (57%) felt they had learned 
something about getting along with people in the past semester. More FWS stu- 
dents (44%) than control students (14%) felt, "I can meet people more easily 
now." Two FWS students (12%) mentioned\hey can get along with, adults better 
now, but no control student did. (See Appendix C.) ' 

All students were as^ced whether they were treated as adults and about 
some specific relationsh'ips with adults: "Can you speak up?" "Are you being 
listened to?" "Are you free to ask questions?" "Are you expected Vo be respon- 
sible?" "Are you being talked dowr to?" Somewhat more FWS students (94%) than 
control students (71%) felt they were treated as adults. The statement ^ 



"sometimes they don't listen" was made by a few FWS students- (19%) and control 
*students'(N%). (See Appendix C.) - • \ " 

Near: ly all students felt that they could speak up and that they were ex- 
pected to be responsible. FWS students and all but two contfol students felt 
they were being listened to and were free to ask questions. There were some 
differences between the groups in attitudes about being talked down to: no FWS 
students felt th^ey were.being talk'ed down to,* buf some control students (21%) 
did. (See Appendix C.) . ■ 

How did the ppofessioml interviewers relate to the FNS and control stu- 
dents? (Btudent Interview) • ' , 

The professionals conducting student interviews were asked to give their 
impressions of each o'f the FWS and OPS students interviewed. Interviewers were 
instructed to iudge how well a student handled himself in the interview situa- 
tion and to make any judgments they thought relevant about his behavio". Sev- 
eral things should be kept in mind when' evaluating these judgment data. Al- ^ 
though the interviewers were experienced in the interview situation, they were 
not trained observers of ^ human behavior. . They used their own references in ^ 
making thein judgments. Interviewers did. know whether or not the student being 
interviewe(i was enrolled at FWS. However, the interviewers' statements were' 
analyzed without reference to the group the student belonged to and the overall 
rating was made from the interviewer statements about the student; the rating 
^was not an overt judgment on the part of the interviewer, ^ 

Table 3.35 shows the results of the interviewer judgments of the students. 
An outside contractor ^lnaly2ed the written judgments of the interviewer^;. Four 
dimensions were identified from the statements: openness,^ confidence, skill in 
expressing himself, and maturity of the student. Note that the interviewer did 
not always make a judgment that could be class ffied on each dimension. In addi- 
tion, the interviewer statements werq rated to determine whether the interviewer 
viewea her relationship with the student as clearly positive, clearly negative, 
or both positive and negative. * 

interviewers judged the FWS students to exhibit more confidence,^ to 
be better in expressing* themselves , and to be more mature than the control stu- 
dents. Overall, the intervieWers* judgments were more "clearly positive" to- 
ward FWS students '(56%) than control students (29%). These statements should 

« 

.be tempered by the recognition that these could, be chance differences. 



TABLE 3:35 • 
INTERVIEWER JUDGMENTS OF STUDENTS 





Experimental 


Control , ^ 


Interval' ewer 


1^1 = 16 


N' .= 14 


Judgment 














t • 








f 
1 


1 










Open > * 


'9 

r 


56 * 


8 


f 


Reserved ,^ 


7 


44 


6 


43 


Neutral 


U 


U, 


u ^ 




Tonf i dent 

\j\J III 1 U^l 1 l« 


4 

8 


50 


4 


29 , 


Unsure 


5 


'31 


9 


9 

65 


Neutral - ' 


0 

V -J 


19 ^ 


1 


7 


Good self-e;;pressiorf 


9 


56- 


• 5 


3^ 


Poor self-expression 


3 


19 ; 


2 


1.4 


Neutral 


'4 


25 


7- 


. 50 ^ 


Mature 


9 


■56- 


'5 


• 36 


Inmature 


. 4 


'25 


2 




Neutral 


3 


19 




50 


Clearly positive interview 


"9 


56 


, 4- 


29- 


relationship 


1 








Clearly negative interview 


, 5 


31 •. 


5 


36 


.V^elationship 










Both positive and negative 




:i3 ^ 


5 


■36 


interview relationship 


r 
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Basic Skin's ' . • . • . ^ 

Does the FMS individualized approaah assist students asking for help 
i-^ basic skill's? ''('Initial Planning Fom, SPPSi) ' 

Table 3.26, page 83 shows the number of students who indicated during^' 
the diagnostic period that they would like-to have extra help in the basic 
skills area. Twelve students asked for help in either reading or writing. 
At the end^of.the school ye^r, all but one felt' that the program had been ' • 
at least somewhat helpful."^, ^ ■ ^ 

.A number of'entering students felt the need for extra help 'in mathe- 
matics; -15 out of 35 enteri-ng students 'requested help in th-is area. At the 
•end of the school year, nine* of these students who Vequested help felt the' . 
•program had been somewhat helpfuV'to them, while two felt it had been very 
helpful. However, four students out of the group requesting help felt at 
the end of th^ year .that the program'had not been, helpful . 

JHao helpful, do FWS gtudentSt consider the basic skills area of the 

progl-am? . (Student Interview, SPPS) , ^ 

■ j* * " . > 

During the student interview a higher proportion of control, students 

(64%) than FVJS students (44%) expressed positive feelings about their writing 

'skills. The 'Statement "I can write 'well" ^was made more by control students 

^(36%) than by FWS student^ (T2%).. A positive change over the past semester 

in writing skills was-observed by" more FWS students (38%) than,contro1 stu-, 

dents- (14%). The statement "school has not helped me in writing" was made 

by more control students' (42%) than FWS students (19%). {See Appendix C.) 

Most FWS students (88%) land control students (93%) had positive attitudes 

about their reading skills. The statement "liRe to read" was made by more 

FWS students (62%) than control students (43%). A positive change over the. 

past" semester in reading skills was observe'd by 19% of FWS students and 7% • 

of control students. The statement, "school has not helped in reading" was 

"niade by some control students (50%) and FWS students (44%). (See Appendi,x C.) 

Relatively few positive -attitudes about their math skills were expressed 

by either group: FWS students (12%) and control students (29%).. The statement* 

J'don't like-^mat)i" was made by some control students (43%) and FWS students 

(31%). "No change" over the past semester in their math skills was observed • 

by approximately equal" numbers of FWS students (69%) and control students (64%). 
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The statement "school has not helped at all in my mcith" was inade more often 
by control students (57%) than by FWS students (38%). (See Appendix C.) 

In the Student Plans and Perceptions Summary, students were asked to ' 
rate the helpfulness of seven schoo^ areas. The questions and analysis 
procedures have been, described previously on page<^84 Data related to 
ba^ic skills are reported in Table 3.36. * • ^ 

The dajdf in Tabl^'3.36 indicate that' experimental control groups- , 
rated the helpfulness of their programs about the same. The one statistical 
difference (mathematics) suggests a superiority for FWS. 

\ ' . TABLE 3.36 
STATISTICS* FOR FOUR ^GROUPS ON SELF-REPORTsIdF HELP IN BASIC SKILLS . 



Item 

(J-Point Scale; 
3 = Vexy Helpful) 


1 , 

Group 


FWS 

Experimental 


OPS 
. • Control 


FWS . 

Entering 


OPS 

Representative 


School he! peel • w/an 
ine in reading. 

N 


2.V7 
.72 
• 12 


i:92 
.79 

12 ■ 


2.26. 
'62 ^' 
34 


2.21 
•.66 
24 


0.,65 

p >.10 " 






School helped Mean 
n)e in writing, 

N 

H* 

IF 


2.31 
.75 

13 


2.25 
.87 

12 


2.53 
-.61 
34 ' 


2.48 ■ . ' 
.73 

' 23 


O.Ol 

P ^-lo 
























Sfchool helped Mean 
me in liiath. 

N 

H* 


2.00 
.82 

13 


1.33 
.65 

12 


1.83, 
.75 . 
35 


2.13 
.85 

24' 


4.62 

.05" > p >.025 























* H is the Kruskal-Wallis test statistic corrected for ties. 
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\What were the r^.sults of the pie/past administmtion of the laoa * 
Tests of E-dxieationaf. Development to FWS expeHmental md OPS contra Ljroups 
The Iowa Tests of Educational .Development -(ITED) were administerfed to 
FWS students and the OPS control group' students in November and May. They ^ 
were also administered to the OPS representative group in May.* Grade 
equivale-nii scoffs were used in the analysis of data presented >n this section. 
The prpblems inherent in the use o.f such scores afre well documented.** 
Nevertheless, grade equivalent scores ace .used here because of the fami-liarity 
of manyv readers with such scores, and because of** their apparent simplicity of 
interpretation. * . • S 

Statistics for data obtained at t^e year-end (May) testing for ea£h of . 
the tUrel groups are presented in Table 3.37. These descripti ve statistics 
show that all three. groups obtaitred Scores.that are below the average for 
th.e national" normative sample used to derive the grade equivalent scores for 
this test. The statistics also demonstrate that overall, the FWS student- ' 
group that took the test more like the comparison group than the control ^- 
group. The most important information that ^an be obtained. from the table 
is the evidence of various kinds qf explicit or implicit selection that has 
taken place for the three groups. For example, t'he proportion of grade leVel 
to group members varies widely, the erratic progress.ion of the'.mean scores 
across grades also illustrates the efffects of selection. 

The problems posed by the effects of differential selection were such 
that only two kinds of comparisons seemed likely -to be meaningful. - The 
first is the comparison of the FWS students "with the national norms sample 
data as reflected by mean grade-equivalent scores. The second is th'e com- 
pari son of the subgroup of FWS students ' (Group C) for which there was a . 
randomly selected control group. • 

Data presented in Appendix C can be used as a basis f or ^conipari son of 
FWS students witt> the national norms sample. "These data can aVso'be useful 
' ' ^ J 

*The tests could not'be admini^^'ered to the OPS Representative Group in 
N^ember because .of Oakland Public Schools administrative considerations. 

**Anaoff, W H. "Scales, Nonn, and Equivalent Scores." In R. L. T'^o'^n^i';^ . 
fed r Educational Measu^em^ . 2nd edition. Washington: American Council 
on Education, 1972, pages 523-525. 
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as a description of the heterogeneity of the FUS atudent group. I„^r.v,e„,„g 
these data, it should be ren,e,nbered that at the tine of .nidyear testing stu- . 
dents wera -variously in grades 10.4, 11.4. and 12.4 respectively; at t e end 
of the year 'they would have' been considered to be at approximately grades 10.9, 

"■''irllLber, the FHS students we;e on the Tverage below the .ean for the 

national noms sample by nearly-one grade point in ''''.^'''^'';)Z\T IfZe 
,h math, and between one and two grade points in reading. M 
year * difference be^een the average scores for the FWS students a d the 
'national no^s sample are of about the sa.e magnitude except for he language 
test *where the differences have increased to about 2.6 grade points. The 
CO Is t y Of this- increase in language-score deficit across grades suggests 
hat t^e deficit may result primarily fr™ the assumption of linear grow ,n 
the average scores of the noraative sample. The data >n these .tables al so 
illustrate very well the heterogeneity of FUS students, ifenerally, the 

er^ ran=ge of grade scoces is fr™ five to seven grad. points for any of, 
t hree te ts at any of the three grades. This hete^geneity underscores 
tie need for an individualized" or pe.onali.^d approach to the remed,at,on 

" "rrnirgllr-assessment of the effects of the e.^Hence on cha e 
■ i„ lUD socres must, of course, be based on an analyses us,ng d ta obta ne 
L c^parable groupsV students^ who did and did not have sue experience. 
"Analyses of covariance of *e ITED math and reading scores , for the expen- 
::tr^roup « and -control (Group 0) groups.were co^P'eted us,ng he «ay 
scores as the criterion measure and the.November score, as 
The means and standard deviations for these groups are presented ,n 

'■'"'Table 3.38 sh-ows 'that the experimental group h'ad a greater averag^ change 
. on ie math test than did the aontrol gn>ap, but the f^^^^f \" 

.indicated that *e difference is not significant. On the ^^^^^^'^J^^^ 
. control group changed more than did the experimental -group. ' ^ ^ 

of covariance. the errors of.estimate for the two groups were = 8 ^ 
^different at the .01 level, and the regressions, of the Hay - - ° *^ 
Nov»ber scores were significantly different at the .10 level. J^-' 
. is no accurate test of tKe significance of the difference ,n "^^^ 

se^s clSar that the two groups do differ in a nu*er of ways wUh respect 
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TABLE 3. 38 . . • • 

STATISTICS ON I TED MATH AND READING 
SCORES FOR FWS EXPERIMENTAL AND OPS CONTROL GROUPS 





Math ■ 


Readi ng 


o statistics 


FWS 

Experimental 
N=12 . 


^ oPs 

. Control 
N=10 


FWS . 
Experimental 
■ N=12 


OPS 
Control 
N=10 




Nov.' 


May' 


Nov. 


May 


Nov. 


May 


Nov. 


May , 


Mean * 


9.4 


10.1 


8.9 


9.1 


10.0 


10.4 


. 8.8 


10.2 


Standard deviation 


1.8 


1.4 


1:8 


2.0 


2.6 


• 2.3 


.3.4 


2.5* 


Correlationf 


.64 


.74 - 


. .92 ' 


' .*48 



to change in the reading scores. There was, however, one student in the 
control group' who ^howed a gaio;of 7.2 grade equivalent points in reading 
fron] the beginning to the end ol^ th6 yeTf,' which) is an extremely Targe in- 
crease for? one year, even allowing for errors^ of measurement/ If this pair 
of^scores had been omitted from the analysis*, the increase in the average 
reading score, of the cpntrol group would have been only 0.8 instead of 1,4. 
There is no information about this student, or about the testing conditions, 
that would justify omission of her scores, but thi's dramatic chang* ^n the^ 
means that can resul t 'flrom ^he inclusion or exclusion of a single student 
does illustrate the effect of extreme scores when only small samples yielding 
skewed distributions are available. . 

In summary, the. FWS<,students and students from the Oakland Public School 
,who are in the' control and comparison groups are on the average appreciably 
below the national norms in the ITED measures. There is no evidence of any 
meaningful or reliable difference betweenTWS and control group, students in 
the rate at which they develop in math. The results of the reading test 



show that the groups differ in a numbeV of ways, but these differences max 
be largely, attributable to the effect of' one atypical student in the control 
group. • , ' , " * 

I>id FWS studepits progress in written oomuniQatiop skills? ^ , ' 
' Because effective communication is so important in career-development, 
a sample of written-' communication was. obtained from all Far West School 
students at the begiTining and end of the schocrl year. For the pretest, 
students were asked to write on a, topic of interest; five possible topics 
were offered for students who could not quickly think of one. For the po^- 
test, each student was assigned one of four topics, the assfgnments bei^ig^ j 
made to' assure that a given student would be writing on a topic simila,nto 
what he chose for. the pretest Students were given approximately 20 minutes 
to write the essays •■■pnly, a few of the essays exceeded in length the equiva- 
lent of one page o/'double-s paced -typing.- Thirty-four of the students com- 
pleled the writing. -sample exercise before and after the school year". The 
discussion belov; is based on daja from these students'. ! 

In prep'aration for the ta^ of judging the quality o-f the samples, each 
written ess^ ms typed in exactlj' the form written; i.e., with all of the 
errors, paragraphing, and so on,^ ^s written by students.; A random iden- 
tification number .was assigned td each- paper so that those reading the essay 
would not know whether they had been written at the be.ginning or end of the 
school year. Four readers were chosjen from a pool of experie^nced readers wh 
had graded essays in large-scale external " testing programs; all were members ■ 
of English "department faculties at their respective institutions. 

* Tfte decision was made that every essay would b$ read and graded by all 
-four readers, and that the score for an essay would be the average of the 
four ratings. The order in which the papers were read varied for each reader 
. so a particular paper would be read at different times during the day. It 
was,,dec1ded that the essays should be judged by the readers with respect to ^ 
three characteristics: mechanics of writing, effectiveness of communication, 
and maturity or logical thoughtful ness . The choice of these three character- 
/ istics w^ ba'sed on consideration of program objectives, di.scussions with 
learning coordinators ^.^f their day -tO;ji^y {perceptions of student "communication 
chafacteri sties, and a quick, holistic reading of all of- the essays by one staff 
member. . ♦ " 
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• "When the essay readers assembled, they were given a draft definition of 

each of«the three characteristics, presented in terms of qualitative 

descriptions o,f several -levels of written essays that might be fbund'^by them 

in their reading. The readers were then each given the same five essays 

written b;^ five students cmd"^sked"^tCL rate "tfrei^aiDers on the b"asis of the " 

draft definitions. After reading these essays, the readers reassembled to , 

• • / 

review and- discuss their ratings and to arrive at a« final defi^nition of the 

*• . • 

characteristics and^ Keating scales they would use. In this process, they 
defined an additional point on each of the first two characteristics, and 
extended a few of the definitions in order to relate s^tudeht performance to 
adequacy for daily use and amount of additional instruction necessary, to 
improve the student's writing skills. The final definition of the three 
rating scales are presented below, ' ^ ^ 

Writing Sample Rating Scales Definition |, 

Mechanics of WHtiyig ^ 

Rating 5 . Virtually flawless writing that would be considered 
distinguished for a high school 'student. The student does not need any 
particular 'help to improve hi's writing skills. 

Rating 4. A number of mechanical errors, which may result from careless- 
ness more than a' lack of skills. The\^riting would be considered generally 
satisfactory for most purposes of daily life in business or other comniunica- 
tion^rieeds* The student coulcl profit from having someone go over the paper 
with him and draw his attention to the errors, but probably would need little 
additional training to improve his writing skills. ' ^ 

Rating 3 . The writing is^ reasonably good, and the errors are not so^ 
'serious as to interfere with comprehension on the part of the reader. The- 
student does nefed more ins'truction or- training in composition, and in som 
instances might need as much as the equivalent of one more semester course 
in composition. " ./ 

Rating 2 . There is a clear impression that some major aspect of composi- • 
tion has not been learned by the student. The errors are seripus enoCigh to ^ , 
interfere wi^h comprehension on the pant of the reader. The student nSeds . 
specialized help thaf might be obtained through small-groun instruction, 
with a little individualized assistance from a teacher. • 

-ilf)* . 104 ' . 
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. Rating 1 . The errors a»:e so serious and frequent that comprehension 
by the >*eader is nearly ^impossiVle. There is probably no. situation for which • 
this level of writing would be Considered adequate/ Improvement of writing 
skills would requ i re completely individualized approach' to remediation". 

Effectiveness of Communication - ^ / ^ ^ 

Rating^4> Sequentially ^stated ideas have a relation to each other; if 
there is a shift from one topic to another, there is consistency within, topics- 
The sample includes an introduction or premise, a set of considerations or 
arguments, and a conclusion. 

* Rating 3 . The purpose^f the writing is clear, and the message gets 
across, but'there is some lack of coherence that interferes with ^he overall 
effectiveness of communication. 
• Rating 2 . there is some indication of relation- of diffl*rent ideas, but 

not necessarily in sequential order. The sample is little more than a collec-. 
tion of related ideas or thoughts. . . 

Rating 1 . This is a, collection^-of nearly unrelated ideas, connected at 
• best by some coimion words. When a reader is done, he dges not have any Idea ^ ■ 
of what the writer wanted to say, ajid many of the ideas may not even be re-- 
lated to the topic chosen. - 

Maturity or Thought fulness ^ - . 

' Rating 3 . The writer shows evidence of haying th.ought about the topic, 
cites some previous experience that is relevant to the^-topic, and shows that- 
l\e has drawn some conclusion from the experience- 

Rating 2 . There is some .evidence that the writer has "drawn on his own 
'.knowledge and experience in a way that is relevant to his ideas. ^ 

Rating J . There is virtually no evidence of thought about the topic^. ^ - 
and no reference to experience; the writing may also contain several very 
improbable ideas or expectations. 

In considering the definitions of the three characteristics, the readers 
expressed uncertainty' about whether they could rate the essay? for the third 
characteristic independent of the second. After hearing a brief explanation 
of the rationale for thinkingnhat experience-based education might lead to ^ 
differential _rates of development of the two characteristics, the readers, 
agreed to try to distinguish the two. They devtted time to clarification in 
terms that might make it possible to distinguish the two characteristics. 
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Estimated Reliability 

As noted above, each of the four readers rated every essay, and they 
•'could not knov/ whether they were rafing a pre- or post-test or how essays 
could be matched for a aiven student. Thus for purposes of estimating the 
•reliability of the raJnngs assigned for -a given characteristic, therefore 
*\eight ratings for a particular student (four raters for pre-te5t scores and 
four for post-test scores). This yielded six interrater correlation coeffi- 
cients for the pre-test and six for the post-test. The distributions of the 
12 interrater correlations and the median correlation coefficients for each 
score are presented in Table 3.39. Since the score. to be used for further* 
analysis is the average of the four ratings for a given score, the estimate 

TABLE 3.39 

DISTRIBUTIONS OF INTERRATER CORRELATIONS FOR 
THREE SCORES ON THE WRITING SAMPLES 
.• (N=34) 



. Correlation* 
Coefficients 


Mechanics of 
Writing 


Effectiveness 
of Expression 


Logical 
Thoughtful ness 


' .70 - .79 


^ 

^ 3 






.60 - .69 


' 5 


3 




.50 - .59 


4 


5 


2 


, .40 - .49 




4 


3 


.30 - .39 






. 3 • 


.20 - .29 
.10-^ .19 




1 


0 
3 


.00 - ,09 






^ 1 


Number of 
correlations 


12 


12 


12 


Median * 


.61 


.53 


.34 


Est^i mated reliability 
for average ratings 
(Spearman Brown) 


.86 


.82 


.6.7 



^ * these medians were calculated from distribution with finer grouping' 
than that'used here. 



of the reader reliability for these average sco)*fc5,was obtained by applying 
the Spearman -Brown Prophecy Formula -to the median correlation coefficients. 
These values' are also shown in Table 3.39. it^an be seen from this table 
^Jiat the estimated reader reliability" of the. average ratings for each student 
on each^ of the three scales is quite high— certainly high enough for use in 
assessment of program effects--with the possible exception 'of the third scale, 
Logical Thoughtfulness. . • " . 

The estimation of the reliability of ess.ay tests, as distinguished from - 
reader reliability, is a difficult and expensive task. It is even more 'dif- 
ficult to obtain estimates of the reliability of several scores derived from 
the same essay, ais- in this instance, because of possible problems of halo efr 
feet, the possible, minor variations in standards of, the reader over time, and 
among readers, andn^o on. In the present instance, the small number of students 
for.whom data were available and the magnitude of the total program evaluation 
effort that was undertaken, meant that the estimation'of score reliability had 
to be limited to obtaining upper and lower limits for such reliabilities. 

..The intercorrelations among the six ayerage scores for each of the stu- 
.dents were. used to obtain a rough approximation of the lower limit of *the' 
reliability of these average scores as indicators, of student skills, and were 
also used as a basis for examining the question of the experimental dependence 
of the second and third scales. (These intercorrelations and appropriate 
means and standard deviations are presented in Table 3,40, ) 

Clearly, the estimated reader reliability represented the upper limit, 
although it is undoubtedly an overestimate of the Score reliability. The 
lower limit of the score reliability was detennined in this case by the use 
of the highest correlat*"' n between any two scores thatwer obtained from 
different samples of writing. For the Mechanics and Effectiveness scores, 
the correlation between the pre- and post-measures of these characteristics 
was used as the best estimate of the lower limit; for thq Thoughtfulness 
score, the correlat^ion between the pretest measure Of this characteristic and 
^thfi posttest measure of MecbBnics was use.d as the lower limit. 

If the procedures used for establishing limits. for score reliability 
estimates are accepted, the limits shown in Table 3.40 indicate that the 
Mechanics and Effectiveness scores are sufficiently reliable for use in 
program evaluation; the reliability of the Thoughtfulness score may be on 
the borderline for such use. Since there are no data available from a better 



;iient of some criterion for the determination of an increase. Such a criterion 
wa^ established based on two kinds of considerations: ' the amount of individua^ 
change that would be required so that one could be confident .that the observed 
•change was greater than could be attributed simply to the unreliability of 
the pre- and post-scores, and the magnitude of change that might be required 
to have some meaning educationally and for career preparation. 

The first consideration was approached by choosing a reasonable single 
figure* as, ar estimate of the reliability,>jso that the standard errors of 
individual scores and of the differences, between two scores obtained by an 
individual could be calculated. As discussed above, upper and lower limits 
for the test reliability had been obtained. In the absence, of additional 
data, it seemed reasonable to use a value somewhere near the midpoint of this'' 
range as a working estimate of the score reliabilities. The values chosen 
for the estimated scare reliabilities, standard errors of measurement, and • 
standard errors of the differences between individual scores are shown in 
-Table 3.41, 

TABLETS .41 
RATING STATISTICS .PQR WRITING SAMPLE 



Statistic 


Mechanics 
of Writing 


Effectiveness 
of Expression 


Logical 
Thoughtfulness 


Reliability 


.75 


.70 


.65 


Standard error 


.40 


.35 


.30 


Standard errc'*^ 
of difference 


.55 


".5Q 


.45 



I 



The s^econd considet^ati on mentioned above, th?t of educational meaningful- 
nessi was approached by considering the score definitions. Since they were 
stated in terms of both quality of the writing and the effort needed to im- 

'prove skills, it seemed appropriate to conclude that an increase of half a 
point or more is sufficiently large to be meaningful to the students. Since 

* this half-point difference is approximately equal to the. estimated standard 

♦ 
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error of the differerVcVi)'etween individual scores each of the three scales, 
the decision was made that an increase»of one, half-point ar more in the average 
rating incitement would be accepted as indicative of a real improvement in^ 
writing skills, - - i ' . 

~ Pre- .and Post-Test Differences / 

The distributions of the. differences in individual scores on the pre- and 
post-tests presented in Table 3.42 show\theft percer\t of students whose written* 
communication scores increased/ by nfore than one standard error of the differ- 
ence is much higher than, would be eJcpected (16%) than if there were no increase 
for the group as a whole. Approximately 55% of the students showed a sign-ifi- 
cant increase in Mechanics and in Effectiveness, and none of them showed a 
significant loss in these skills. A smaTler percentage (41%) showed a signi- 
ficant increiase in Tljoughtfulness , and two students showed a signi^ficant loss. 

^. TABLE 3\4? 

DISTRIBUTIONS OF DIFFERENCES BETWEEN PRE AND POST WRITING SAMPLE SCORES 



Differences* 


Mechank? of 
Writing 


Effectiveness 
of Expression 


Logical 
Thoughtfulness 




f 


% 


. f 


% 


f 


% 


1 .50 and higher 


4 • 


12 










1.00 - 1.49 - 


4 


12 


^ 7 


21 


5 


15 


0.50 - 0.99 


11 


32 


12 


34 


9 


26 


0.00 - 0.49 • 


11 


32 


8 


24 


13 ■ 


38 ■ 


-0.50 - -0.01 


H 


"l2 


7 


21 


5 


15 


-1.00 - -0.51 










2 


' 6 


Total. 


34 




■ 34 




34 




Maximum possible 
diffei'ence 


4.00 




3.00 "• 


* 


2.00 




t % above 1.00 




6.35 




6.19. 




3.97 


P 




<.001 




<.001 




<.00l 



* The interval size is equal to the standard error of the difference 
between individual scores. . * 



The t-test results shown alf the bottom of Table 3.42 represent a test of the 
difference between the percentage showing a significant increase and th^ 
expected value of 16% that would occur by chance. These three tests deinon- 
strate that Far West School^ students as a group did increase their skills as 
measured by the Writing Sample during the 1973-74 school year. Inspection of S 
•the differences broken down in subgroups of FWS students did 'not suggest any 
ribticeable differences from one i^roup of students to another. 

In summary, a large proportion of Far West School stuWs showed increases " 
in their writjng ski'lls that were both sta^tistically and 'educationally signifi- 
cant. Writing samples were not available for a control group of'^tudents, so 
it is not possible to attribute the'se- increases specifically to the ^WS . 
experiences. . . " \ ■ 

. ■ \. 

Career Awareness an d Planning 

Do FWS students feel the program is helping them to prepare for the n 
future? (SPPS) ^ ' ' * 

The comparison of experiinental and control groups on the self-report data 
shown in jfable 3.43 supports-the hypothesis that' FWS is effecti^ve in preparing 
st.udents for work and helt^ng them to make post-high school plans. ' 

fioh> have students changed in their statements of short-term and Jong- term ' 
plans? (SPPS) V ' ' ^ * 
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FWS and OPS students were asked, at the beginning and end of the school 
year, what they expected to be doing one year. after' completing high school. 
The original format called for the student to check one of ten responses. 
Some students checked more than one response; in this case the multiple 
respojKe was ^educed to a single response by use of a coding scheme which 
favored (1) academic over vocational or work (on the basis that many young 
people are primarily students but must also work)', and (2) full-time over 
part-time wQrk. The original coding scheme will be found ia the SPPS proced- 
ures and coding manual located in Appendix C, along with the prigijial question. « 

The ten original res[3onse categories were combined into four to produw 
Table 3.44, which shows the change frojn pre to post-test for the experimental 
and control .groups, for FWS entering students, and for the OPS repre§entati ve ^/ 
group. Table 3.44 indicates^ the extent to which menters of each group tend 
to gi-ve a response ^'n the same area for both pre- and post-test. Grouping of 

\ 

ni 



TABLE. 3.43 



STATISTICS FOR FOUR GROUPS ON SELF-REPORTS OF HELP IN PREPARATION FOR THE FUTURE 

• • 1 >> 



Item 

Scale; 
4 = Strongly Agrp^e) 


Group 


FWS 

Experimental 


OPS 
Cqntrql 


FWS 
Entering • 


'ops 

Representati ve 


School helped prepare 
me for work. 

Mean 

SD 

N 

H* 


3.1-5 
.55 

13 . 


2.25 
' .87 
12 


3.29 
.57 y 

35 


2.33. 
.87 

24. .. 


7.2Q 

\01 > p 






School helped pre- 
pare me for college. 

Mean 

SD 

N - - 
H* 


3.17v • 
.58 
12 


2.58' 
.67 
12 


3.03 
.63 
34" 


'.2.91 
.60 
» 23 




4.44 
.05 > p 








School helped me 
decide "pUst high ' 
school plans. . 

Mean 

SO 

N 

H* 


V 

\.25 

A. 


1.67 
.49 

12 


3.24 
.'55 
" 34 


.. 2.42 
.83 
24 


\ 16.85 . 
.005 -> p 

































* H is the Kruskal-Wallis test statistic corrected for ties, 
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, TABLE 3.44 

MATRICES OF STATED POST- SECONDARY PLANS OF STUDENTS 





FWS Experimental Group 


OPS Control Group 


" PRE-TEST CHOICE 


Post-Test Choice 


Post- 


test Cho 


ice 






VoCt-: 
Trng. 


Work 


' Acad, 
Educ. 


Other 


Total 


Voc 
Trng. 


Work 


Acad. 
Educ. 


Other 


i Uta 1 


Vocational Training 


2 


1 


3 


0 


6 


0 


^ 2 


0 


0 


2 


* 

Work 


0 


0 


0 


1 


1 , 


0 


3 


0 


1 


4 • 

* 


Academic Education 


0 


0 


3 


1 


4 


2 


0 


2 


0 


4 


Otfier 


1 


0 


0 


1 


2 - 


0 


0^ 


0 


2 


2 


TOTAL 


3 


1 


6 


4 

• 3 


"13 


2 


• 5. 


2,v. 


3 


12 





FWS Entering Group 


OPS Representative Group 






Post-Test Choice 


-} 


Post-Test Che 


ice 




Pre-Test Choice 


Voc. 
Trng. 


Work 


Acad. 
Educ. 


Other 1 


. Total 


Voc. 
Trng. 


Work 


Acad. 
Educ. 


Other 


Total 


V; 

Vocational Training 


3 


3 


6 


0 


12 


. 2 


0 

V 


0 


0 


2 


Work 


0 


2 


1 


3 


6 


1 


2 


0 


0 


3 


Academic Education 


0 


1 




2. 


12 




2 


12 


■ 0 


17 


Other 


2 


0 


1 


2 


5 


0 


0 


0 


0 


0 


TOTAL 


5 


6 

ff 


17 


7 


35 


6 . 


4 


12 

f 


0 


22 
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responses along. the diagonal' indicates a low amount of change, while a 
scattered pattern shows shifts from pre- to post-test. 

From Table 3.44 it is evident that there is less change, i.e., less 
movement away from the .diagonal, for the OPS groups. For the OPS representa- 
tive gvoup-, 16 out of 22 students gave res|)ons'^s in the same area for pre- and 
post-test. In contrast, only 16 out of the 35, R'JS* entering group (less than 
half) gave a similar response on the pre- and post-test. This group a'lso^ 
showed a much wider scatter throughout 'the "4 by, 4 table (the post marginals 
indicate a spread over all four areas), while the OPS representative group 
made no use of .the "other" category which allowed students to specify unique 
plans for the future. 

The ORS representative group showed a reduction in the number of students 
who were planning^ college education; those students lost from that grOup in- 
tended either 'to have vocational training or to go to work! In contrast, the 
FWS entering group gained in the, number of students planning a college educa- 
tion, picking up a number from the vocational category, which^was not popula/ 
witfi this group in the post-test ratirvgs.,,; • ^ 

Another question*on the SPPS asked students about' their long-range plans--- 
what they expected to be' doing in* five years. This question was open-ended and 
was originally coded into' 14 categories. The categories were reduced to four 
areas for presentation in Table 3.45. A comparison of the experimental and 
control groups shows two 'unique patte^rns. The control group sees Itself as 
working at an identifiable type of job in five years, probably of a non- 
professional nature. In contrast, the experimental group has made a dramatic 
increase in p]ans which involve continued school In five years and has re- 
duced the number of specific jobs that it can identify in its future plans. 
The .experimental group is more inclined (Post) to say they "'don't know" what 
they will be doing 1n five years, ' The two patterns i<ientified above are also 
evident for FWS entering students and OPS representative students. 

• In summary^ it appear.s that FWS students show more variability in re- 
porting their future plans than 4oJGP^ comparison students. FWS students 
are more inclined to change- their plans and to consider a wider variety of 
options. They are increasingly interested in furtfwring their education and 
less interested in vocational training. It appears that Far West School has 
been successful in encouraging students to "keep their options open," to 
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learn about a variety of careers, and to be more realistic about the educa- 
tional demands of many professions, vlt is also evident that FWS has a ' 
significant^ influence on increasing the proportion of students whose plans 
include further education . 

Uhat was the level of students* post-secondary planning? (Student ^ 
Interview) • . ^ - 

Both the FWS arj^d the control students were asked what plans they had made 
for after high school , Somewhat more FWS students (-81%) than control students 
•X64%) had made plans to go to college. /More control students (2U) than FWS ' 
students (6%) had made no plafts at all .for after school, (See Appendix C) 

' ' How helpful did studdnts judge the school program to he in making post- 

high school plans? (^mdent Interview) 

More students judged the FWS program, to be helpful in making post-high 
'schocl plans (88«) than control students (50%) did in judging the helpfulness 
of their school programs. Some control students (435^) said their school was 
not helpful; no FWS student said this* The FWS program was'preceived ^to give 
the student (krection for his future by more students (38%) than control stu- 
dents' (none) .perceptions" of their school programs. The school program w^s 
judged to be "not relevant to the student's future" by more control students 
(36%) than FWS studenj;s (none). '(vSee .Appendix C.) 

infomaJtion sources were helpful to students in making decisions 
about their future? (Student Interview) 

Most. FWS students (75%) and, control students (86%) had made decisions 
about their future. Student groups differed in their sources of infomation 

'J 

to help them make decisions: many more FWS students (52%) than control stu- 
dents '(7%) talked with people in their fields of interest a^out thei r possible 
future. Some control students {zh>) and some FWS. stU-dents .(19%)_„got.help..ln 
making decisions frm an-a'dv^sor or learning coordinator. (See Appendix C.) 

fjow do students feel about work and gobs? (Student Questionnaire) 

The students were Very positive in^looking forward to having jobs and 
to having a choice of occupations; they believed that hard work could have an 
eff6ct on achievement. They were appreciably less positive when asked if 
\ they felt most people receive satisfaction from their work, and a-re about 

ERIC ^ ^ 



evenly divided in their opinion of whether people work Just to earn money 
or for other reasons. * ' , 

The data from which these student characterizations were derived are 
^presented in Table 3.3, paje 46^ which shows the questions, the frequencies 
in each of the three- response groups, and the t-test value. 

Do FWS students consider inaveased accveev awareness cm important outaomp.? 
(SPPS) « • ■ . _ , ■ 

Each Far West School student was asked to rate on a five point rating 
scale" 26 aspects of the Far West School program on the basis of the succes.s 
of these program elements 'toi" thi^student. A complete discussion of thi^ 
rating scale will be found in Chapter 4. FWS entering students rated "Learning 
About Careers" as the second most successful element in the program, exceeded 
only by "Learning Coordinator's "Future Career Planning" was seventh in rank 
for this group with a mean ratfng of 4.09 on a five point scale. 

Hccoe -the attitudes of FWS students ahanged toward the world of work as 
a result of experience .in EBCE? (Job-Related Attitude Scales) ^ 

' It, was expected that the FWS experience might result in a change in tM 
attitudes of'students toward the world of work, especially because they would, 
now view this world from the perspective of concretely understood jobs. To 
determine.^whether such effects did occur, the FWL^EBCE evaluation staff de- 
veloped the Job-Rented Attitudes Scales, an instrument comprised of four 
scales or clusters of opinions. These clusters will be most meaningful if 
th^^s (incluc^M in Appendix C) are examined that' were used to derive a 
cluster^score. To make this chapter of the report more coriiprehensible, the 
clusters are here identified by name,- aJl though the particular label used 
should not b(*. seen as too significant because it generally describes -he^^ 
highest end of the particular scale, while virtually no students had opinions 
-qui te that exTreme:" ir"sRouTd-a^ 
i.e., a low score does not necessarily represent an attitude that is opposite 
to that implied by the scal| name. The clus^s are defined in the fable 
below. 
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TABLE 3.46. 



CLUSTERS OF OPINIONS IDENTIFIED^H^ THE 
ITEMS OF THE JOB-RELATED ATTITUDES INSTRUMENT 



Opinion 'Label 


• 

Cluster 


* Number of 
Items 


Possible . 
Score Range 


Anti-supervisors/enployees 


1 


8 


g - 40' 


Pro - CO mp any/ b us i nes s 


2 


6 


6 - 30 


Cautious acceptance of 
working for others 


3 




6 - 3p ^ 


Cynical acceptance of job 
conditions 


4 


5 


5 - 25 



•4 



Various. studies of the reliability of th^se scales suggest. that for 
FWS students the reliabilities are in the range pf .65-. 80. This means * 
that in general they are accurate enoughlfor group assessment, but not for 
individual assessment. ^ 

Results obtained from the administration of these opinion items at the. 
beginning and end of the year are presented in Table 3.46. (pnly students 
who entered FWS in the fall of 1973 (Group OBC) were used in the presentation 
of this table. These students also responded to these items at midy&ar, but 
since their responses were used in the cluster analysis, data for 'the cluster 
scores are not presented here. 

The correlation coefficients in Table 3.47 indicate that the four clusters 
are independent of each ^other for these students. (The standard error of these 
correlation coefficients is .17; a hypothesis of zero cor^^elation ainong the 
four scales could not be rejected by cbnventionaj^-rT^naards. ) It is evident 
that "these cllsters^epresenT different "diffiensions^ior^he underlying attitudes. 

Examination of the differences in the pre- an(J post-mean scores indicates 
very little change in average level of opinion. The group. does appear to be 
somewhat more diverse in its opinions at the conclusion of the year at FWS, as 
evidenced by somewhat larger standard ^deviations, but these differences are 
not large enough to be considered significant. 
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An analysis of covariance was performed on the cluster scores obtained 
by the experimental (Group C) and control (Group D) students. The control 
group students completed the opinion -items only at midyear and at the- end of 
the year; the midyear scores, rather than the beginning-of-year scores, had 
to be used as a control vaj^iable, along with student age. The means, standard 
deviations, and correlation coefficients for these two groups on each of the 
clusters are presented in Table 3.48. The analysis of covariance showed a 
significant difference between (the gVoup means for Cluster 2. The test of 
the errors of estimate for these two groups was quite significant, however, 
so the accuracy of this test of significance is uncertain. 

The analyses of covariance also^showed that the errors of estimate for 
Cluster" 4 were significantly different, and the regression systems for two ' 
clusters approach statistically significantly difference. A review of the 
5catterplots of the scores for these clusters was not helpful in interpre- . 
tation of these results. 

In summa^ry, the Job-Related Attitudes Cluster Scales appear to be useful 
measures of four dimensions of attitudes toward the world of work which have 
obvious content relevance. There is, however, little or no ev.idence to indi- 
cate that one year in FWS .changes the stated opinions that reflect these 
attitudes as measured. It seems reasonable to conclude that the attitudes 
are complex and probably persistent. A longer period of time is probably 
required if the attitudes are to be changed. 
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SUMMARY OF OUTCOMES BY PROJECT OBJECTIVES 
/ 

The information presented in this section leads to conclusions directed 
to two major kiTids of questions: What do the key participants in the FWS-EBCE 
acti vities--the students and their parents, %nd the adult volunteers at the 
resource si t^ii^^ljivlnk of the school as a means, to achieving the student-centered 
objectivf^<; adopted by the program? What'progrcss was made by the students in 
achieving these ob-jectives? 

FWS As Means to Student Outcomes 

Student outcomes are, of course, the most important criteria by which an 
educational program can ba judged* In evaluating a developing activity, iden- 
tifying, creating, and improving the program processes encompasses a set of 
initial major objectives* These objectives are the target for formative evalu- 
ation, but important information of a summative nature can also be obtained. 
The important summative question in this regard is: What do the key participants 
think about the crucial factors in the pr.ocess? The answer can be principally 
obtained from the perceptions of participants; the perceptions have validity 
only to the extent that the questions seem relevant. 

Student Perceptions of FWS 

Eighty-five to 90% of FWS students expressed a strong preference, for FWS 
in comparison with the scho<fI?^ey had attended previously, and said that if 
again faced with the choice, they would apply to FWS. The major reason^ for 
this preference can be summarized as: (1) FWS provides much more practicial 
experience and education, (2) FWS allows more individual freedom and responsi- 
bility, {3} FWS provides opportunities to learn about occupations, and (4) FWS 
is. much warmer arjd riendlier than regular schools^ When asked to . ^te school 
characteristics, 75% of the FWS characteristics were rated positively and none 
were rated negatively by FWS students; OP-S students rated 29% of them positively 
and 50% negatively. Students were generally positive in their opinions about 
the learning coordinators*. In a free-response interview^. 50% of the students 
cited specific ways that the learning coordinators had been helpful and nearly 
as large a percentage used terms lhat essentially described the learning coor- 
dinators as warm and friendly. 
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Parent Perceptions of FWS 

. When asked to characterize the FWS in a free response, 83°/. of the- parents 
made positive responsjes. When the^ were asked'^bout 19 parti'cular character- 
istics, 50% of the parents rated the school positively or very positively on 
17 of the characteristics; on 6 of the 19, 80% of the parents were positive 
or very positive. When asked how the school affected their children, parents 
cited with great frequency factors such as: (1) students liked FWS better 
than previous schools, (2) students had bettJ^ attitudes about themselves, (3) 
students seemed more interested and motivated to learn, (4) sttidents took/more 
responsibility, and (5) students learned more about work and careers. Parents 
also were, positive in their opinions of learning coordinators. Twenty-five of 
'34 parents said the learning coordinators were enthusiastic'about the school 
and their jobs, and two-thirds of the p'arents rated the learning coordinators,, 
as being of very high quality. The parents did rate the coordinators relatively 
lowe^with respect to frequency of contact with parents and effectiveness of . 
school-parent communication. 

' Student and Parent Perceptions of S'cbool Resources 

The parents were quite positive in their ratings of resource people and 
organizations;, since parents' knowledge of resources had to second-hand 
through their children, this is probablya reflection of student opinions. 
This probability .is confirmed by the fact that 94% of the studerYts said they 
had benefited from resource persons and 56?! said they had benefited from in- 
volvement with community or other resource organizations/ Some students said 
they had not benefited from the resource organizations, but no , student reported 
that resource persons had been of no help. About two-thirds of the students 
said they had learned a lot from the resource person?. 

Resource Perceptions of Students and the School 

Two- thirds of the resource persons said they thought the experiences at 
the resource sites had been worthwhile for the students .and nearly half said 
-that the students they worked with had increased their job knowledge and 
abilities. Only one RP said he was dissatisfied with the student(s) who had 
come to his site. More than half said tliey thought the students had made 
appropriate use of the opportunity provided at a specific site. Three RPs 
were negative, primarily because their students did not keep appointments and 
did not notify them. ' ^ 
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student Outcome Objectives 
Self-knowledge 

Significantly more FWS than OPS 'students said their self-confidence had 
increased during the year, and that they felt they could express themselves 
more effectively in a one- to-bne> situation. More FWS students believed they 
had learned about themselves because they had had to think for themselves more 
often, and more FWS stucJents attributed increased sfelf-growth to the activities 
in the school than did OPS students. FWS students said the school had been 
effective in helping them assunie responsibility and^in evaluating their own 
performance and activities. 

Interpersonal Skills 

Far West School students expressed the opinion that the EBCE experience 
had been effective, in .incre'asing their ability to "communicate with people in 
cT mature way," and to work with others, and had helped them to n'mprove their 
interpersonal skills. .^They rated the school significantly higher th.an OPS . 
students rated their schools with respect to having^ helped them learn to get 
^long with others. FWS 'students also rated the school higher than OPS students 
rated their, schools with respect to how much it helped them to meet and deal 
with people, but the difference was not as significant. 

Basic ^Skills 

Written communication : On the basis of a writing sample judged for quality 
by independent raters, FWS students^ showed a very significant increase in their, 
knowledge of the mechanics of writing, their abijity to communicate effectively 
in writing, and the maturity of their written thoughts. "When students rated 
their school with respect 'to help received in improving writing, FWS and ORS^ 
students did not differ significantly. On an interview rating, FWS Students 
rated th6 school's help in iniproving writing low relative to other accompli ish- 
ments, although they still considered the school's help to be satisfactory. 
It seems clear that FWS students do improve their writing skills,,, but jrhere is 
no reason to assume FWS is either more or les^s effective than OPS schools in 
this regard. 

Reading : Results for reading essentially parallel those for written 
communication. Oh a standardized reading test, FWS students did improve their 
reading skills, but not significantly more or less than PPS students. There 
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is virtually no important difference between the two groups with respect to 
the,i"r opinion about how much the schools helped them or how much reading 'sk|l1 
they had gained or lost during the year. Again, it seems clear that the'^S * 
experience does not result in ar^ disadvantage relatiVe to students in mo're 
conventional high schools. , 

Quantitative skills : The results with respect to quantitative skills for 
FWS students are essentially the same as foip the other two basic skills. FWS 
s^tudent effects are not significantly different from those obtained by OgS 
students with the exception that FWS experimental students rated their program 
as sfgniTicantTy jnore helpfuj in mathematics than did the OPS control students/ 

^7 Career Awareness and Planning ^ . 

Significantly more FWS experimental students than. OPS control students" 
felt that tjjeiiju^chool had helped prepared them for work, for college, and in 
making post high 'School plans • Almost 90% of FWS students said that the school 
had helped them in planning for their future, while about one-half the OPS^ 
students said this, A significantly Ijarger number of FWS students than* OPS 
•students reported that they had also talked about their plans with people who 
were working in fields of possible interest. An analysis of -student statements 
about, long-rtertn plans 'made at/ the beginning in relation to those made at the 
end of the school year showed that FWS 'students had shifted in the direction 
of "keeping their options open" by continuing education or* training. The per- 
cent of OPS students who had apparently chosen specific jobs was significantly 
higher than was the FWS student percentage.' *The irmnediate post-school plans 
of FWS students also reflected more of shift from beginning to end of year, 
but they were .not significantly different from the OPS students in this respect. 

. Thirty-six percent of the OPS students said that -they 'saw no relevance of 
their school projram to the'irs plans for the future. No FWS student made such 
a statement; onjbie' contrary, FWS students rated- learning about future careers 
as the second most -important feature of Far West School . 
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CHAPTER 4: OUTCOME BACK*UP RESEARCH 



INTRODUCTION 



Many questions were posed in Chapter 3, above/ The informa-tion used in 
exploring those questions was classified^ somewhat arbitrarily,^ as program out- 
come data, though it was recognized that the material does not in itself ade- 
quately define the outcomes of the FWL-EBCE program. Limitations of the data,, 
having to do mainty with the incongruency between the nature of the program and 
♦the state of the art of program evaluation, ar&rtreated sufficiently elsewhere. 

Further data are presented here that lean(more toward the research ap- 
proJtch than evaluation. The four studies described are intended to serve as 
background materia? to provide the reader a different vantage from which to 
view EBCE and the presentation of .its effects on Far West students and staff. 

Appearing first is a description of ait anthropological study that^^^f^ts 
what has been happening from the perspectiv^s)f the ultimate consumers, thex 
students. The complete report of the study is Vinci uded in Appendix D.. 

A second study is. presented to indicate relative effectiveness of a 
variety of program features ^and to attempt to ^erive meaningful core dimen- 
sions from those features. 

Next is a study to explore the hypothesis that there are differential 
sets of attitudes toward tests and testing held by students tested in connec- 
tion with the evaluation this year. If so, these attitudes need to be identi- 
fied, for they could conceivably affect the meaning of group differences in^ 
test! scores. 

^Finally*, the notion was entertained and explored that there may bis fun- 

♦ -* 

damental differences among members, or, especially, among organizational com- 
ponents of the EBCE staff that if identified might help to explain certain 
operational problems or program effects. 

ANTHROPOLOGICAL OBSERVATIONS 

A continuirrg difficult^^ for EBCE evaluators ha's been finding measurements ^ 
that are at once sensitive and relevant., but also flexible enough to evaluate 
a program such as EBCE. The traditional pre- and post- test experimental/control 
techniques have been helpful but seriously limited in ti/acing student progress. 
Some dimension!; of the- program are unable to "sit still" for such testing. It 

j " 
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extract from his resource site—does learn-hov^ to travel through the' city. 
He learns a strate'gy for getting from one place to another in an often com- 
plex transportation system. 

Although there is similarity in 'the proje^ settings where th^ stifdents 
go in the community, Alvarez and Hishiki founo-little Komogeneity in the re- 
source, people (RPs) and what they demand from the student. If this is occa- 
sionally somewhat disorienting, the study found that Far West students were^,^^^ , 
generally nonetheless well enoughjwtivated to make intelligent demands on the 
RPs and to attempt -to difrect the situation in such a way^that their goals 
could be met. While there were unsuccessful meetings between the students and. 
RPs, students were usually flexible enough to be.abte to deal -with disrupted 
encounters, even trying to rechannel them into an alternative form. 

As far as relationships with the staff were concerned^ the study found 
that although interaction was characterized by a general informality and flex- 
ibility, a distinct boundary is retained between students and their learning 
coordinators. "The learning coordinator," Alvarez and Hishiki write, "main- 
tairts a skillful balance of informality, friendship, and authoritarianism to 
which the student has learned to adapt:" The staff is gener^ally succef^lful be- 
cause it is able const'antly t(f reinforce the message (in indirect ways more 'of-, 
ten than directly) that Far West js a school wh^ere each student mus1>per form 
and finalj^be evaluated on certain jointly, conceived expectations. 

Oneyof the beneficial features of the trusting relationship/between learn- 
ing coordinator and student, according to the study,, is the willingness "to 
listen to each other on matters of mutual importance." The authors observed a 
constant give and take about the Far West program, with students freely criti- 
cizing 'it, offering*^ suggestions for its improvement, and generally manifesting 
a stake in its success. The continuing dialog about the school, problems stu- 
dents were having in the community and with the staff, and their strategies for 
.changing the program all became part of the dynamic of the learning process. 

Professor George Spindler supplied a codicil to the Alvarez-Hishiki study, 
highlighting a few conclusions. Noting that there are many other areas a simi- 
lar, but much* more exhaustive inquiry might have probed (.a more intense "ethno- 
semantic" examination of student reactions; a more thorough "time-space mapping" 
of their movements in, the community). Professor Spindler said that such. a study 
as thi's does produce insights that might well be missed by an evaluation of the 
formal structure of a phenomenon such as Far West School. He concludes: 
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^The evidence in the report clearly indicates that Far West 
School is achieving most oy its aim^ quite well^, perhaps ex- 
tremely well... Much of wwit the individual participant learns 
is learned outside of the fraftework of system expectationsV> 
^ven In the case of a flexible system as that of Far West 
School. 'It is clear, however, in the analysis that has been 
done^ that* Far West students are learning from each other and 
through cas-ual encounters as well as through their .encounters 
wljth RPs. , 

ANALYSIS OF'PROGRAM COMPONENTS; 

Far West School provides an unusual opportunity to study -how program 
features interrelate. The FWS program incorporates a nuniber"'^of innovations," 
including highly individualized student participation. Studies of inter- 
action can help Identtfj^core EBCE elements and explore their relative ef- 
fectiveness. » 

During year-end testing, FWS students were asked to rate 26 features of 
the Far West School program. Each item was rated on a ,5-point scale from 
"not at all successful fof* you" (value - 1) to '"very successful for' you" 
' (value ^ 5). The rating scale formed Question 12 of the Student Plans and 
Perceptions Surmary (SPPlS) . A copy of the instrument is included in Appendix 
C. Data collected ;from analysis of this rating scale can be used both to ex- 
plore the effectiveness of program features and, when combined with informa- 

* 

tion on student charaoteristics, to explore certain student/program interactions. \ 

yixat do students see as successful elements in the program? 

Table 4.1 shows the ranking of means for the rating of program features 
by FWS entering students (Group, OBC). It is noteworthy that the' first nine * ^ 
of these items, ranked in terms of "suG(;ess" as experienced by students, are 
considered by developers of the model to constitute the nucleus of the FWS 
program. These elements of the program were seen as successful by almost* 
all students. The middle group of items in the ranking are more concerned * 
with specific aspects of the experience-based curriculum and are also seen 
as quite success/ul. The nine^Teast popular items ranged from' ''forms as 
planrling tdols," found successful by 15 students, to "diagnostic testing," 
found successful by only nine students. The placement of^cademic and 
'basic skill items iiear the bottom of the ranks reflects theJwide disper- 
sion of ratings on these activities, ranging somewhat evenly from not suc- 
cessful to successfuK The rating of the tutoring program shows bimodal dis- 
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TABLE 4.1 



SUCCESS OF 26 PROGRAM 
« 



FEATURES OF THE FAR WEST SCHOOL RANKED BY MEAN 



FWS Entering, Group OBC. (N=35) 



• 


Rank 

/ 


/ Reduced 3-Level Scale 


Y 

5-Level 
Scale 


cn 

, ou 

5-Level 
Scale ' 
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Learning coordinator^ 


1 
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0 
L 


0 J 
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4.57 
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Le-aming about careers 


2 


1 
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9 




n 
u 
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Learning ^bout oneself 


3.5 


1 
1 


c 
0 


9Q 
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,83 


Learning to make decisions 


3.5 


1 


c 
0 


OO 
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U 
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.83 


Individual meetings with LCs 
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\' 


90 
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.. 86 


Resource persons 
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i 


V 


97 


n 
u 


4.14 
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Future' career planning 


7 


1 


c 
0 


90 

CO 


U 


4.09 
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Project planning 


8 
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4 
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4 


97 
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t 

U 


3.97 
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Resource explorations 


9 


o 
0 


Q 
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CO 
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U 


3.89 


.95 


Credit assignment 


10 


3 


10 


90 

22 


vJ 


3.80 
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Resource center 
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O 

c 
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CC 


U 
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.93 


CofTwunity resources^ 


12.5 
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0 


^ 12 


9n 
2U 


U 
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Advisory group meetings 


12.5 


4 


n 


91 
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1 


3.71 
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Orientation at resource sites 


14 


c 
D 


19 

\c 


1 7 


n 
u 


3.49 
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Resource guides 
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D 


11 


lo 


U • 
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1.08 


Resource' organizations 


16 


7 
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0 
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0 

c 


3.45 


1.21 


Social activities 


1:^ 


Q 
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n 


3.34 


1.17 


Forms as planning tools 


18 




lU 


1 c 
1 0 


1 


3.32 


1.18 


Physical education activities 


19 


11 


"9 


. 15 


0 ; 


3.26 


1;20 


Learning academic skills 


20 


7 


16 


12 


^ 0 


3.17 


1.13 


Improving basic skills 


21 


11 


11 


13 


0 


3.14 


1.12 


External college classes 


22 


11 


6 


15 


3 


3.13 


1.63 


Tutoring program 


23.5 


14 


5^ 


14 


2 • 


3.00 


1.46 


Learning packages 


23.5 


10 


12 


12 


1 


3.00 


1.08 


Feedback from resource si^'tes 


25 


. 11 


13 


n 


0 


2.89 


1.14 


Diagnostic tes^i^ng^ 


26 


16 


10 


9 


0 


2.57, 


1.32 
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tribution. The relative degree of dissatisfaction with physical eaucation 
activities, learning packages., and, feedback from resource sites probably re- 
flects deficiencies in this year's program. ' 

'lat fwe the cove dimensions of the FWL-EBCE program? 

•Facty analysis was used for associating groups" of proyran^related items 
with studefit characteristics. Nine student-characteristic variables were added 
to the 26 ratings of program features, and intercorrelattons were computed- be- 
tween variables. The student variables included such demographic data as grade •- 
Wei, entry school (high or low socioeconomic), and entering grade-point awev- 
agp (GPA).. Added to these variables were spring credits earned, the internal 
and external usage variables, and the Personal Orientation Inventory (POI) Spon- 
taneity Seal?. ■ ^ ^ 

- "Internal Usage" and "External Usage" variables were developed from ratings 
by the learning "coordinators (LCs). Each FWS student was rated by each of Jhe 
-three learning coordinators as being^a "heavy" or "light" user of (1) internal 
resources at the FWS Learning Center, and (2) external, comiiunity-based resources. 
A score of 2 was used to denote heavy use, and a 1 to represent light use. A 
mean of the thre^r ratings was computed for internal and for external usage'. 
These^mean ratings arevthe variables used for this analysis. 

\ The variable identified as the POI Spontaneity Scale is one of ten sub- 
scales of the Personal Orientation Inventory that was administered to FWS stu- 
^ dents during pre-testing. POI "spontaneity" is defined as "freely expresses 
feelings behavi orally." 

■From the matrix of 35 variables, a principal -axis factor analysis was com- 
puted, followed by a Varimax rotation.* Table 4.2 displays the seven resultant 
factors, which account for 64% of the variance; from 7% to 11% of the total 
variance was associated with each factor. The -first 26 variables in Table 4.2 
consist of items from the rating scale; the remaining nine items are student 
variables. Each item is identified in Table 4.? and the value range of the 
• student variables- is indicated. v 

The rating scale items in Table 4.2 have been reordered to better display 
the factors. All factor loadings above .30 appear in the table. The highest 
loading for a variable appears without parentheses; other loadings are enclosed 
in parentheses. 



TKe program is available at the Far West Laboratory Computer Center and follows 
Veldman's- "FACTOR" programming procedures. Veldman, D.J. Fortran Programming 
for ttie behavioral Sciences. New York: Holt, Rinehart and Winston, 1967. 
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TABLE 4.2 

>ACTOR' MATRIX OF PROGR/\M FEATUf|eS tf} STUDENT CHARATERISTICS 



Factor loadings Over .30 
(decimals omitted; secondary loacMifg in parentheses^ 



VariaDlc 


I 


II 


III 


IV 


V 


VI 


VII 


'~ 


RATING SCALE ITEMS 










Individual meetings with LCs 


81 






• 








Learning coolrdinators 


70 








• 

(-31). 






Advisory group meetings 


61 












Project planning 


54' 


(50) 






(-35) 






Resource persons 


52 








(-36) 




(30) 


Future career planning 


48 














Learning about careers 


42 








(-35) 


' (-33) 




Tutoring program 




85 












Improving basic skills 




82 












Learning academic skills 




61 










(-38)' 


Learning toxmake decisions 


(34) 


56^ 




' (41) 








Resource explorations 


(43) 


54 












Feedback from resource sites 






80 










Resource center 






73 










Orientations at resource sites . 


» 


(31) 


63 










Cbnmunity resources 














(-54) 


. Social activities 






53 


(45) 








Resource organizations 




(39) 


' (44) 
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Learning about oneself 






49 


* 






Learning packages 








-46 


(-41) 






Physical education activities 










-74 






Diagnostic testing 










7 


(-38) 




. Resource guides 












-68" 




Forms as planning tools 






(44) 




(-46) 


49 




External college classes 












-81 


Credit assignment 


(38) 












'■ -55 



STUDENT CHARACTERISTICS 



Erttry school 1 = low SES 












66 




2 = high SES 














Sex 1 = male 








66 








2 = female 














Ethnic »group 1 = white 

2 = non-white 


(38) 

1 










-67 


(-31) 


Grade 1 = 10th, 2 = 11th 




(-34) 




(-44) 






-62 


3 = 12th 












1 

43' 




External usage: mean score 


(30) 






(-38) 






Internal usage: mean score 


(41) 










59 


(-44) 


Spring credits 






(-46) 






51 




PCI: Spontaneity Scale 










63 






Grade point average 




(-43) 




45 




(37) 
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In this study, factor analysis was used as an exploration tool to, assist 
in generating hypotheses about the various features of the FWS program. The* 
factors to be- discussed can be considered no more than interesting suggestions 
and are -clearly in ne,ed of supporting studies* The sample of students is extreme- 
ly small for factor analysis. The student-tied variables are generally complica-. 
ted representations of the characteristics for which tt^ey are named. Partly be- 
cause of the small sample size and^.partly because of the confounding ef'fects, 
many of the variables simply cannot be separated. In sum, these' factors are only 
hypotheses and should be viewed with a good measure of caution. 

For reasons stated above, this summary of the. factors in Table 4,2 deals 
only with the, 26 program variables. There are several factors in the table sug- 
gestive of meaningful clustering of program features. Factor I appears to qe- 
fine the major unique features of the model, with emphasis on interaction with- 
instructional peoole at both the Learning Center and resource sites, and on 
project and career planning. Factor II defines a cluster of program features 
that might be called "being turned on to learning," i,e,, indicating motivation 
toward learning basicSfcademic and decision-making skills. Factor III is less 
easily characterized, but may be indicative of a level and kind of involvement 
in those program features that, when taken together, suggest some information 
seeking, but also some "going through the^inotions" witti lower-payoff activities. 
Beyond these tjire'^e program clusters, interpretation of the factors in Table 4,2 
becomes less sehsi^le. 

The analysis, with all the limitations discussed, does appear to show that 
this kind of emp^irical approach; to the definition of core features of EBCE is a 
promising one that should be follo>ved up, . ^ 

TEST-TAKING ATTITUDES 

It was apparent to evaluation staff that there might well be resist- 
ance to tests among FW^ students as a consequence of the many instruments and 
the lengthy sessions which were devoted to diagnostic and evaluative testing 
early in the fall semester. For this reason, a decision was made to examine 
students^ test-taking attitudes. If resistance was present, it appeared 
reasonable that giving students an opportunity to "go on reconT^m-ght atten- 
uate the effect of test-resistance In subsequent data collection at year-end, 
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TABLE 4.3 

PERCENT CHOOSING KEYEO AlTERNATfVE ON TEST-TAKING ATTITUDE ITEMS FOR FOUR GROUPS 



Key 
.'V^ Agree 
D-Oisagree 



FWS 

Experiniental 



OPS 
Control 



FWS 
En torincj 



OPS 

Rppre^eatativc 



I. It is Qood to have tests to give us 
information about people. ' ^ 

I beltevd that schools give too many tests 
to students. 

3. It is all right to ask questions about my 
future career plans on a test, 

I feel upset when I cannot answer a test 
> question. 

5. I would have no objection to answering 
questions about my personal life on a test. 

6. It is all right to take tests to help a 
person choose a career. 

7. I like to answer test questions about (qy 
interests. 

8. I believe it is possible to find out how 
much one |}^s learned by taking an 
achievement test. - * 

9. I feel scared when I know I am to take 
'4 test of any kind. 

10. I believe i( ib possible to find out how 
bright I am by taking an intelligence test. 

II. \ m looking forward to a day when I never 
take any more tests. 

12. I think it is a good practice to "guess" 
on a test question. 

13. I believe there are "tricks" that will 
hplp you to score well on tests, 

)4 T eimtionally upset when I am told 
that I am to take tests. 

15. t am not afraid when I am taking a test. 

16. I on)oy taking a test when I have studied 

t\ir the SiUbjprt, 
« 

17> I do not want ny pareats to know how I do 
on tests. 

H \ usually aqrpo with the results of tests 
i *»ave taJ^en. 

V* Z* believe that schools use tests properly 
foost of the tune. 

i'-) iest quest ions -make ir^e feel like arguing 
itJ Hit the right answer. 

'\' t believe test scores would be helpful for 
jnf in makinq a career choice. 

J2. Ih^re is considerable fear of taking tests 
amont) students I know. 

23. I am not easily distracted when takinq 

.1 test. 

?4 i teol anqry when I forget the answer to 

t question I =^hould know. 

2^1 I believe that most people cheat on tests 
It they can get away with it. 

26. I believe that people often lie about 
themselves when taking a personality test. 

27. I am tired of takinq so many tests. 

28. It* doesn't matter to anyone whether or not 
* I answered those statements the way I 

really fetl. 



D 

A 

0 

A' 

0 

0 • 
0 

0 

A 

0, 

A 

A 

A 

A 
0 
0 

A 

0 

D 

A 

D 

A 

0 

A 

A 

A 
A 



29 
47 
12 
53 
71 

24 

35 

12 
53 
59 
47 
24 

18 

24 
35 

29 

41 

35 

59 

35 

35 

53 

82 

'65 

53 
71 

24 



21 
71 
7 

36 
50 
7 

14 

64 

29 

71 

57 

36 

29 

7 
29 
14 

29 

29 

57 

64 

21 

50 

36 

86 

93 

' 57 
50 

14 



29 
63 
15 
42 
71 
22 
22 

44 

22 
66 
66 
34 

2^ 

12 

27 
34 

29 

51 

46 

63 

49 

34 

54 

68 

76 

59 
76 

24 



13 
42 
13 

^^ 

52 
26 
7 

29 
45 

J9 

10 
23 
23 

16 

39 
V 

4a 

45 

VA 
90 

ai 

45 
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Questions designed to determine attitudes toward tests were arranged so 
that agreeiTient or disagreement with a statement would randomly reflect a posi- 
tive or negative attitude. Responses were then scored to yield a total score, 
based on each negative opinion being given a score of and each positive 
opinion a score of 0. Thus, since there were'2§ questions, the total score 
could range from 0 to 28, with a score of 28 indicating a student had negative 
opinions on all questions. 

Table 4.3 presents the items making up the test* and the percent choosing 
the keyed alternative for each item in the experimental, control y entering FWS, 
and OPS comparison groups. Total score means and standard deviations for- the 
same four groups are given in Table 4.4. A Kruskal-Wallis test of the rankings 
on the basis of total scores for the experimental and control groups showed 
them to be highly similar. 



TABLE 4.4 



DESCRIPTIVE STATISTICS FOR FOUR GROUPS 
ON TOTAL TEST-TAKING ATTITUDE SCORE 



Statistics 



Group 



on Test-Taking • 
Attitude Score 


FWS 
Experimental 


OPS • 
Control 


FWS 
Entering 


OPS 

Representative 


Mean 


12.19 


11.29 


- 12.90 


10.94 


Standard deviation 


4.93 


4.71 


■ 4.76 


3.53 


N 


16 


. ^ 14 


39 


31 



*See Appendix C for the instrument and a presentation of technical infoYination , 
concerning its development. . 
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STAFF-PROGRAM ISSUES 

The Position of the FVlS Staff on Major Issuer of Educational Philosophy 

Some difficulties were encountered during the first semester in implement- 
ing various instructional and guidance procedures as intended. (See Chapter 5.) 
One possible explanation is that philosophic differences exist among key staff 
members and that- these differences led to different interpretations of adopted 
.procedures wherever specifications were ambiguous or permitted more latitude 
than was intended. 

In an effort to identify staff biases ^on issues of educational philosophy, 
a rating scale was constructed and administered to ten key members of the 
FWL-EBCE staff. The intention was not to ilfipose philosophic uni-ty, but to 
identify the philosophy underlying the Far West model, including whatever di- 
versity exists, and to make appropriate provisions, fpr accommodating such di- 
versi ty. . . . . • 

The rating scale was adapted from Neil Postman and Charles Weingartner.* 
The Postman-Weingarther position, was selected because (1) it appears to be very 
compatible with the philosophic* basis of EBCE as original ly. conceived .by the 
U.S.. Office of Education and as developed at the pilot sites, and (2) Postman 
and Ijleingartner haVe stated their position in sufficiently specific terms of 
school practice to permit the construction of a rating scale. According to * 
rubtman and Weingartner, all schools, by definition, perform certain essential 
functions, -such as structuring students' time and activities, defining "achiev.e- 
ment" and "good behavior," and supervising and controlling the -young. Schools 
differ in the specific procedures and practices they adopt in carrying out these 
essential functions. It is at the level of -procedures and practices— "conven- 
tions" in the Postman-Weingartner terminology— that schools may be distinguished 
from one another and evaluated. They identify 31 specific conventions, having 
to do with such general factors as the variety of options open to students; 
freedom of student choice; utility and relevance of what is learned; commitment 
to and accountability for reaching prescribed goals; breadth of community parti- 
cipation; and rational, non-authoritarian relationships among participants. 



* 

Postman, N. and Weingartner, C. The School Book (New York: Delacorte Press, 
1973). ~ 
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A 31-iteni rating scale was devetoped by adapting Postman and Weingartner's 
31 conventions. In one version, called the "Ideal" scale, the respondents ware 
asked to consider their personal view of an ideal EBCE program and to rate each 
item with respect to its desirability i^ that i*eal version. A 7-point scale 
was used, where a rating'of 7 meant that the item is "essential" and a rating 
of- 1 meant that it is "totally unacceptable," Abbreviated versions of the items 
are shown in Table 4»5. The complete items are presented in Appendix C. ^ 

The scale was administered to ten members of the FWL-EBCE staff who • < 
were most influential in shaping the FWS model. Seven respondents were 
member^ of the Design Control Committee (DCC) representing senior staff in 
program management, schooV^operations, development, and evaluation. The other 
three respondents were the three LCs, who were most directly involved in the 
implementation of the model at FWS. ' 

Mean ratings for each item were computed for (1) the total group of ten 
raters |LCs and DCC) combined, (2) the seven members of the DCC as a group, 
and (3) the three LCs as a group. Mean ratings for "each/of these three groups 
on each item are shown in Table 4.5. The ordering of tbg^^'tems is by mean 
rating for the total, group of ten raters. 

Results for ratings on the Ideal scale are summarized in Table 4.6. -The 
mean of 6. .36 for the ten ratlits indicates that the senior FWS staff is in 
strong agreement v/ith the PostmaJ^^ position, the mean rating' across 

all 31 items falling between "v^^ desirable" and "essential." Further evi- 
dence of this agreement is that 49.4^ of the 310 ratings (10 raters on 31 items) 
wpre "essential," the highest rating on the 7-point scale. Note that the raters 
were stating the opinion that the item is" essential to an ideal EBCE program, 
not to education in general. ' ^ 



> 
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TABLE 4.5 

MEAN RATINGS 8Y TWO GROUPS. SEPARATE AND COHBINEO. FOR 31 ITEJIS • 
ON A SCALE OF IDEAL EBCE AND A SCALE OF ACTUAL EBCfc AT FAR '.JEST SCHOOL- 



Abbreviated Item* 



J 



1. Question-asking, problem-solving, resetrch valued more than memorizing, vcntriloquiilng. " 

2. Excellence judged broadly *to include other skills « well as reading and math. 

3. Latitude in choosing among optional activities. 

4. Resources fnclude people and problems outside school walls. * 

5. What is learned is valued rather than amount of time spent. 

6. Responsibility ta students' future has higher priority than to social institutions. 

7. ColUborative rather than adversary relationships betvfeen teacher and student. 
h Variety of people, in teaching role. 

9. Reading ability only one way to express intellectual competence and interest. 
•10. Teachers function as coordinators or facilitators rather thail? us dictators. 

11. "New** subjects, e.g., anthropology, cy^bernetics, urbanology, iJcepted. 

12. Self-knowledge dnd feelings accepted as worthwhile, legitimate subjects tf inquiry. 

13. Concept of knowledge, attitudes, and skills oriented toward futjjfre. 

14. Capitalize on teachers' strengths and help them with weaknesses. 
J5. Constructive, nonpunitive evaluation of teachers and administrators. 

" 16. What IS expected and how it will be judged, made clear to students. 

17. Nonpunitive grading, no homogeneous grouping, minimum of labeling. 

18. School Is accounMhl* for its performance to students and parents. 

19. Daily sequences not arbitrary but related to w»{at students are doing^ 

20. Studonts collaborate rather than compete. 

21. Stt«dcnts may supervise themselves, have sense of control. ^ 

22. Brtnq'i together students of great diversity in background and ability. 

23. Chdonels for parent grievances and community participation. 
?1. School small enough that supervision can be personal, human. 
7h. students allowed to organise own time, decide how to use it. 
7h AUei native programs, contrasting arrangements fdr learning offered. . 
^7 ttardardlzcd tests not used, or only with extreme caution, skepticism. 
28. Knowledge fc^r use In dally life valued "rather than "for knowledge's sake." 
2g, Aversive responses avoided,, reinforcing ones appVifid. 

30. School's activities are student, rather than mostly staff, activltici. 

31. RequiroJ activities Justified on empirical or rational basis of relevance. 



Ideal Scale 
Mean Ratings 



DCC 

—4 


OCC 


7.00 ; 


7.00. 


6.90 1 


6.86 


6.80 


6.86 


6.80 


6.86 


6.80 


6.71 . 


6.70 


6.57 


6.65 


6,57 


6.60 


6.57 


6.55 


6.50 


6.55 


6.43 1 


fi.50 


6.43 ' 


6.50 


6.43 


6.50' 


6.36 ' 


6.50 


6.43 


6.50 


6.43 


6.50 


6.43 


6.45 


^ 6.29 


6.40 


6.29 


6.35 


; 6.43 


6.30 


1 6.00 


6.20 


1 6.14 



LC 



6.10 \ 

6.10 

6.05 

6.00 

5.90 

5.90 

5.fO 

5.80 

5.70 

5.70 



5.71 
5.71 
5.86 
6.14 
5.71 
6.14 
5.71 
5.71 
6.43 
^S,57 



7.00 

7.00 

6.67 

6.67 * 

7,00 

7.00 

6.83 

6J57 

6.67 

6.83 



6.83 
6.67 
6.67 
6.67 
6.83 
6.67 
6.17 
7.00 
6.33 
7.00 
7.00 
6.50 
5.67 
6.33 
5.33 

6.00 
4.00 
3.67 



Actual Scale 
Mean Ratinqs 



OCC 
♦LC 



OCf 



-| 

6.15 \ 6.07 

6.05 j 6.00 

6.50; 6«7l 

6.30|''6!29 

5.40 ' 5.14 

i 

5.85 ■ 5.57 
6.20; 6.21 6,17 



It 

6 33 
6 17 

6 00 
6.33 
6.00 

6.sn 



6.70! 6,57 , 

6.25 1 6.21 

5.50 I 5 14 

6.40 i (• 11 



6 33 



5,70 I S.7t 
4.95 [ 4.29 "6.50 



« 83 

4 

6.i3 



4.65 , 4.21 

I 

4.1'>| 4,00 
4.05= 

6.35' t«ri 

4.85' 4 21 , 
6.30!, 6.29 6.33 

6.05 . 6.07 6.00 

5:35 j 5^21 \ S.67 

6.40 j 6.29 ' i b; 

4.00 ! 3.79 1 4, Si 



1^ I 



6.20 

5.95 1 6 21 ' ^3'i 

5.60 ; S.29 . t 

4.30 ! 4:07 ^ 'i.^a ^ 



5.10 : 5.29 
4.65 ! 4.57 



5.40 
5.25 



5/50 
5.64 



.33 
4.83 
5.17 
4 33 



* See Appendix JC for full statement of items. All items adapted from Postman, N. and Weingartner, 
^ 139. 
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C, The School Book. New York: 0<»lacort,e» 19^3 



ERIC 



r 

TABLEM*6- 

, • a 'r. 

. • ^ IDEAL SCALE MEANS AND 
. RANGES OF ITEM MEANS FOR TWO GROUPS OR RATERS 
. " AND FOR THE COMBINED GROUP 



Rater 


Mean for 


Range 




All Items 


Item f 


feans 


LCs (N=3) 


0 6.41 


3.67s> 


7.00 


DCC (N=7) 


6.34 


5.71 - 


7.0Q 


Combined Group (N=10) 


6.36 . 


5.70 - 


7.00 



While the LCs tended to give higher ratings (mean = 6.41) than members of 
the DCC (mean = 6.34),* the difference is not statisticaMy significant. How- 
ever, statistically significant differences were found among individual raters 
with respect to how strongly they favored the Postman-Wei ngartner position. Re 
suits for individual raters: a ra sljown in Table 4,7, individual differences 
among raters within the combined group, the DCC, anfl LCs are all statistically 
significant,* These differences appear to have no practical importance, how- 
ever, in view of the concentration of individual ratings n6ar the upper end of 
the scale;'i.e., these differences occur, with very few exceptions,"^ within a 
very restricted range of positive ratings, * ^ 

It is possible that the scale items are^ simply "motherhood" statements, 
and that the scale is insensitive to important differences in staff attitudes^. 
For example, it is doubtful that any rater would favor "adversary" over "col- 
laborative" relationships between teachers and, students (item 7 in Table 4.5 
and item 20 in Appendix C). But raters could^/ell d^iffer in their beliefs 
about how directive and authoritarian a teacher should be in cqrtain practical 
situations. The scale as presently constructed does not get at such differ- 
ences in staff attitudes. 



Respective values of F for the total group, DDC,. and LCs are 3.36 (p<.01), 
2.86 (p <.05), and 5.30 (p <.01). . 



TABLE 4.7 

IDEAL SCALE MEANS 
AND STANDARD DEVIATIONS 
FOR INDIVIDUAL RATERS 



Rater 


ncaiib TOr 

All ^Items 


■ otanaara 
Deviation 


DCC:A 


.6.47 


0.48 


, B 


5.98 


0.71 


' C 


6.23 


0.84 


D 


6.65 


0.49 


E 


6.42 


0.85 - 


F 


6.39 


0.65 


■ G 


_6.23 


0.76 


LCs:H 


6.39 


0.96 


I 


6.65 


0.45 


■ 0 


6.19 


1.62 



^ The results with the Ideal scale suggest the following conclusions: 

1. Ten key-members of the Far West EBCE staff are in close agreemenj/ 
in educational philosophy with the position represented by Postman 
and Weingartner. 

2. There .are individual differences among the ten key staff members in 
the extent to which they subscribe to the Postman-Weingartner posi- ' 
tion. These differences occur within a relatively narrow range of^ 
positive attitudes toward that position. 

3. The Design Control Committee as a group is not significantly dif- 
ferent in its position from that of the learning coordinators' as a 
group. 

The Educational Philosophy Underlying the Current Program at FWS 
-~ - — • ^ • . 

To examine staff perceptions of current practices at FWS, a second scale 
was adapted from the Postman-Weingartner conventions. Jhis scale, called the 
"Actual" scale, contained exactly the same 31 items as those in the Ideal scale 
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and was administered to the same teit raters. In the Actual scale the re-^ 
spondents were asked to rate each item on the extent to whicb it had been 
adopted and put into practice at FWS. A 7-point scale v/as used in Wch a 
7 meant "widely practiced'* and a 1 meant "not practiced at all." 

Mean ratings for each item for the combined raters^he DCC, and the LCs 



are shown injable 4'^5v/^^oUp "results are summarized in Table 4.8. The / 
combined-gfqup^mean of 5.56 indicates that the ten raters perceive\ FWS as 
having adopted the Postman-Weingartner conventions fairly extensively. The 
mean rating across all 31 ,items is about midway between /'practiced to some 
extent" and "widely practiced." A two-tailed test of the difference between 
the means for the LCs and DCC yielded a "t" of 3.149, which for 30 degrees of 
freedom is significant at the .01 ie>^el. This indicatea that the LCs (who 
ar^ closer to school Qperations) perceive more extensive adoption of the con- 
ventions than do the members of the DCC. A product-moment correlation co- 
efficient of .60 was obtained between the LC and DCC ratings. This correla- 
tion, which for 30 degrees of freedom is significant at the .01 l.evel, indi- 
cates significant and moderately strong agreement between the two groups in 
their perceptions of the relative extent of adoption of th^„31 Postman- 
Weingartner conventions at FWS. 



TABLE 4. 8 

ACTUAL SCALE MEANS AND 
RANGES OF ITEM MEANS FOR TWO GROUPS OF RATERS 
AND FOR THE COMBINED GROUP 



Rater 


Mean for 
All Items 


. Range of 
Item Mean> 


LCs (N=3) 


• 5.87 


4.33-7.00 


DCC (N=7) 


5.45 


3.79-6.71 


Combined Group (N=10) 


5.56 


4.00-6.70 



Significant differeplces were found among ir{di]|^idual raters. Individual 

means and standard deviations areSshown injable^ 9. Individual differences 

S 

among raters within the cp,mbined group, the DCC, and LCs are all statistically 
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significants* It can be seen from Table 4.9 that the difference in ratings 
bety.een the two groups of raters is attributable principally to the low mean 
ratings of raters B and C and the high mean rating of rater I. It appears ' 
that differences among raters are of greater practical significance than dif- 
ferences between the two groups; i.e., individual perceptions are not strongly 
related ♦to whether the rater is a "designer" or an "implementer. " 

An analysis of the correlation between the ratings on the^Actual and 
Ideal r.cales yielded a produtft-moment coefficient of .34 (conibined group 
ratinp).; For 30*degrees of freedom, this is significant at the .05 level, 
indicating a signl^ficant but quite modest corresponjierice between the relative 
iniportance 'or desirability of the items and the relative extent to which they 
have been adopted at FWS, • ' ' 



TABLE 4.9 

ACTUAL SCALE MEANS 
AND STANDARD DEVIATIONS 
FOR INDIVIDUAL RATERS 



Rater 


Mean for 
All Items 

V 


Standard 
Deviation 
— \ 


DCC:A 


J^26 


0.86 


B 


•4.84 " 


1.71 


C 


4.84 


1.39 


D 


5.5'8 


1.04 


E 


5.23 


1.45 


F 


5.98 , 


1.27 




5.35 


1.67 


lCs:H 


5.02 


1.56 


I 


6.68 


• 0.59 


J 


5.87 


1.09 



Respective values of F for the total group, DCC, and LCs are. 6. 33 (.p< .01 )» 
3.94 (p ■< .01), and 16.21 (p < .01). 
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These results suggest the followiag corfcl usions: 

1. Ten key staff members perceive FWS to have adopted the Postman- 
Weingartner conventions fairly extensively. 

2. There are significant differences among individual staff members 
in their perceptions of practices at FWS. 

3. LCs tend to see the adoption of the Postman-Weingartner conventions * 

a^-more extensive than do members of the DCC. There is strong overlap 

Between the groups, however, and differences among individual raters 

appear to be of more practical significance^^an between groups. - 

/*» 

There is a low positive correlation between the" relative degree of de- 
sirability of the conventions and the relative extent of their adoption 
at FWS as judged by the ten raters. 



4. 
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Differences Between DCC and LC Ratings , An item-by-item analysis was per- 
formed on the' differences between the DCC "and LC ratings on the Actual scale. 
A difference in group means on any item was considered significant if it was 
greater than twice the standard error of the difference. This test resulted in 
the identification of two items, on vihich tjie two groups differed significantly. 
The full statemeWTof one of those items is as follows: 

The school's concept of knowledge, attitudes, and skills is 
orientedgjtoward the future. .It has realistically assessed 
what st^sents will need to know in years ahead^and is making 
, some serious attempts to help them learn those'things. 

For this item the mean DCC rating was 4.29, or slightly above "practiced 
to some extent." The mean LC rating was 6.50, or somewhat 'below "widely prac- 
ticed." This difference of 2.21 is the largest difference between the two 
groups on any item. 

The second largest difference occurred for the following item: 

The school is not afraid to be held accountable for its per- 
formance. The staff tries to make explicit to parents and 
students what it wishes to accomplish (and what it does not), 
how it intends tn do this, and what kinds of evidence it will 
dccept as a sign of success. 

For this item the DCC mean was 4.21 and the LC mean was 6.33, a differ- 
ence of 2.12. 

It was recommended to program management that these and other items may 
signal real problems that ninder implementation and stabilization of the model. 
The designers and implementers may have two distinctly different views of the 
actual procedures at FWS, or the differences may be definitional. For example. 



how do the two groups define "what students will need to know in years ahead," 
"serious attempts to help them learn those things," "to make explicit. . .what 
it wishes to accompl ish, . .and what kinds of evidence it will accept?" Attempts 
should be made to achieve comnwn understanding of key terms and establish 
commonly agreed-on objectives and standards for school operation. Results of 
the ratings have been used as a framework , and ^point of departure for arriving 
at common definitions and agreements. They have also been influential in re'- 
visions to prescriptive documentation of operating procedures and in staff 
training during the summer, / - 
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CHAPTER 5: MODEL DEVELOPMENT AND IMPLEMENTATION 

This chapter presents inf^mation from two areas: (1) a description of 
the formative evaluation process within FWL-EBCE and a presentation of the re- 
sults of the evaluation of major model procedures during FY74; and (2) an as- 
sessment of the instructional system as implemented by the Far West School, 
based on information collected from staff and students through the formative 
evaluation process. 

FORMATIVE EVALUATION OF STUDENT-RELATED PROCEDURES 

Formative evaluation of EBCE -model procedures during FY74 was an integral 
part of the program development process. As such, the main tasks involved in 
the procedures evaluation efforts were performed by development staiFf. Eval- 
uation staff provided assistance in design, data analysis, and review. 

Three major sets of student-related procedures underwent formal testing 
and evaluation during FY74; 

1 . Student Diagnosis 
1 2. Student Orientation 
3. Student Guidance 

For each of these three sets of procedures, an initial specification was made 
prior to implementation; a test plan v?as written specifying the schedule and 
objectives of the evaluation, the kind of information to be collected, the 
methods of information collection, and the proposed methods for analysis; a 
formative-evaluation test report was produced summarizing the findings; and 
finally the procedures were revised in view of the finiyigs. Each o.f these 
steps has full docuirientation in a series of internal teports. Summaries of • 
the important findings are presented below. 

Student Diagnosis Procedures 
\ 

* Preliminary Specification 
During their first few weeks at Far West School, students' interests, cur- - 
rent achievement levels, educational needs, and career goals are inventoried. 
This entry assessment serves two purposes. First, it provides students with in- 
formation about themselves that will help them plan their educational programs. 
Second, it provides learning coordinators (LCsNith information they need in de- 
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veloping strategies to: (1) help individual students identify their education- 
al, career, and personal development aims, and (2) provide students with the gui- 
dance and support necessary to plan and pursue productive learning programs. 

Diagnostic procedures specified that a report be compiled and made avail- 
able to each student and his/her learning coordinator befor? the end of the 
three-week orientation period. The report integrated information about each 
student's interests (both expressed and measured), abilities, FWS and Oakland 
Public Schools (OPS) requirements to be met, and educational and career plans. 
It concluded with recommendations for the kind and level of ^career development 
and educational act-ivities seen bi< the diagnostician as appropriate to the stu-* 
dent's unique combination of needs, interests, and abilities. Each student's 
learning coordinator discussed the report with the student. 

Evaluation Test Plan 

The Test Plan provided for the following data to be gathered and analyzed 
in order to evaluate the effectiveness of the procedures: 

Assessment of PreliminVry^iagnostic Report . This instrument has two 
part?: part one consists of a set of questions LCs were to ask students during 
or innmediately after diagnostic interviews; part two contains questions for the 
LCs themselves to answer concerning the, diagnostic interview. Forty question- 
naires were received. The dates on the questionnaires suggest that many were 
either not completed^at the time of the diagnostic interview or that the inter- 
view itself did not occur until late in the semester. 

Follow-Up Assessment of Prel^;tlBlnary Diagnostic Reports . This questionnaire 
was completed by students at the end of the semester during sumniative evalua- 
tion midyear testing. Forty-nine questionnaires were received. 

Long-Term Planning Forms . A sample of students* Long Term Plans 
were to be analyzed to determine the effect of diagnostic information on stu- 
dents' planning. Examination of the sample revealed that only five out of 20 
of these forms were completed ' after diagnostic interviews. 

^Results 

Table 5.1 summarizes the information collected, the instruments used„ the 
problems encountered, and the action taken to resolve them. 



TABU 5.1 

SUMMARY OF DIAGNOSTIC INFORMATION COLLECTION 



Infonwition Needed 



Instruments to be usea 



Hijor Problems Encountered 



Action Jaken 



OikUnd Public School District 
Requiremnts 

Fir West School Requirements ^ 
M«thei*»tics (pridi-Jcvel perfonwnce) 

Reading (grade- leve) peofonunce) 

Writing 

Oral ConiRunications 

Expressed interests 
Educational and Career Plans 
Mtasvred Interests 



Abilities 



Public school transcripts 



Iowa Tests of Educational Development 



Iowa Tests of Educational Development 



Instrument developed by FWS 



Instrument developed by FHS 

Initial Student Planning Foni 
Initial Student Planning Form 
PLAN Interest Inventory 

Developed Abilities Profile (DAP) 



Inaccuracies «nd/or delays in receipt 



Could not be scheduled until October; 
results available approximately a 
month later. 

Could not b« scheduled until October; 
results available approximately a 
month later. 

Not developtd by beginning of semester 



Not developed by beginning of semester 



major problems 

No major problems 

Self-administered; ^i9^lt students 
did not complete. 



Group administration; necessary to 
administer several times because 
students did not show up. 



LCs obtained, verified, and provided 
students with their course «nd credit 
requirements* 



Percentile rankings were obtiioed 
from an alteniite te$t. 

Percentile rankings were obtilned 
from an altcrnite tcst.^ 

LCs and sicills specialist conducted 
informAMidgnosis and are wnltorlng 
progressi 

ICS and skills specialist conduct'^ 
informal diagnosis anJ are moniiurua 
progress. 



Students received repeated reminder's. 
Diagnostic reports were delayed for 
eight students who did not co<nplete 
the inventory. 

Rescheduled until all students had 
cORH^leted. 

/ 



ik9 



* 



TABLE 5.2 

LEARNING COORDINATOR JUDGMENTS ON USEFULNESS OF DIAGNOSTIC REPORTS 



Question 

0 


No. of 
Students 
in LC 
Groups 


k 

LC's Impression 


Yes 


No 


^ X. 

Did the diagnostician's recommendations 
stimul^t^ thought about and aid ,in-the 
formulation of the student's long-range 
plans? 

Learning Coordinator 3 

Learning Coordinator 1 

Learning Coordinator 2 

TOTAL 


« 

^ 15 
11 • 
14 


13 
7 
1 


2 
4 

13 


.. 40 


21 


19 


Do you think the report will enable you 
to helDt|ne student in program planning?^ 

Lear.iing Coordinator 3 - • 

•Learning Coordinator 1 

Learning Coordinator 2 

TOTAL 


15 
■ 11 
14 


12 

8 
0 


3 

- 3 
14 


40 


20 


20 


Do you think the diagnostic report had 
any effect on the student's thinking 
about his or her Tong-rangq plans? 

Learning Coordinator 3 

Learning Coordinator 1 

'Learning Coordinator 2 

TOTAL 

. K 


15 

11 
14* 


13 
6 
1 


2 
5 

12 


40 


20 


19 



* The learnilig coordinator judged only 1,3 of 14 students on this question. 
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Conclusions 

Based on the test findings and the problems encountered during the conduct 
of the diagnostic program, diagnostic procedures have been revised to specify 
that the following conditions be met: 

1. OPS transcripts are obtained and verified before the semester begins. 
This will necessitate making arrangements to obtain transcripts di- 
rectly from the Oakland schools data bank as soon as they are pro- 
cessed at the end of the semester, and de'veloping procedures for veri- 
fying them with 'OPS counselors. * 

2. The lengthy, initial diagnostic report interrelating a student's ex- 
pressed interests., his/her abilities and interests as measured by in- 
struments, and his/her academic requirements for high school gradua- 

/ tion has been eliminated. Diagnosis has been assimilated into the 

% framework of Student Guidance. As such, it is structured as an on- 
going process of assessment and ^reassessment of student needs, achieve- 
ments, interests, and attitudes. Several specific t^pes of informa- 
tion about the student are collected throughout his/her first weeks 
of eni}Ollment: 

a. OPS District subject and credit requirements for graduation; 

b. reading and mathematics skills l^vel on a national ly-normed 
test (eighth-grade equivalencies are an OPS graduation re- 
'quirement); > 

c. oral communications and writing skills levels; and 

d. educational and occupational interests and goals. 

3. The purpose, nature, and limitation) of all diagnostic tests are ex- 
plained to students, with an explanation o-f how test results will be 
used. 

4. Interest inventories and abilities tests are made optional for stu- 
dents. Students who are not able to express interests or who have 
foreclosed, a particular occupation are strongly encouraged to take at 
least an interest inventprV to give them an empirical base on which * 
to begin exploring careers. 

Student Orientation. Procedures 

Preliminary Specification ' ^ 

The purpose of student orientation procedures is to help s^dents make the 
transition from traditional classroom learning to the EBCE cflrriculum. Orienta- 
tion was designed to: (1) allow students to begin taking responsibility for niak 
ing decisions by choosing among optional activities and scheduling} and (2) pro- 
vide enough structure^ activitie^s so they would know what was expected of t(iem 
at Far West School. The three-week orientation program was to emphasize: 
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1. program planning processes including long-range, semester, and pro- 
ject planning; 

2. learning resources (what they are, how they are used, and where they 
are located) ; 

3. organizational structure of FWS and its' admi nistrative procedures; 

4. diagnosis of students' needs (discussed in the preceding subsection); 
and 

5. student adaptation to, the program (by requiring participatigp in ac- 
tivities related to items 1-4). 

The following techniques were specified for accomplishing the five^oals 
above: 

' workshop discussions within the learning coordinator (LC) advisory- 
group structure, with a maximum of^en students per workshop; 
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group discussions and group practice in completing forms; 

student visits to resources, preceded by preparation from the LC in the 
student group and followed by discussions with the LC and other member- 
of the studSnt group (these visits to resources were to serve as self- 
discovery activities thrpugh which the student would understand the 
need for planning ahead before going to a resource^and would learn to 
use the resource effectively )f; 

self-instruction using modules of the American Institutes for ResearUi 
Car§er 'Guidance Program;"and 

completion by each student of a mini-project which would synthesize 
most of the elements listed above, 

I 

Evaluation Test Plan 

Listed below are the methods which EBCE staff used for gathering evaluative 
data during and after ;orientati on:' 

^ A Student Orientation Objectives Checklist was distributed; the LC and 
student were to complete it together as the student completed the orien- 
tation objectives. 

Weekly LC questionnaires were used during orientation to gather infor- 
mation about the problems and the successes students were experiencing 
during •that period. 

^ ' Tapes of LC discussion sessions were made in v^hich they elaborated on 
successes and problems during the orientation, 

^ A questionnaire was given to all students immediately fol Towing orien- 
tation to elicit their reactions to the program. Only 17 students re- 
tu^rned this and an analysis of these 17 showed them not to be a repre- 
sentative sample 'of FWS students. (Ther^ was a preponderance of fe- 
males, whites, )a^d those who planned to go to college.) 
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^ , The staff drev/ a random sample of 15 students, five from each LC gi^up, 
acid reviewed their files closely to see whether they had completed 
orientation objectives. This judgment of their completion of orienta- 
tion objectives was compared with that of their LCs, Three months la- 
ter, the staff interviewed 11 of these students to find out whether 
orientation was helpful in the long run, 

^ Instructional and development staff members were given a questionnaire 
which required theln to prioritize both the information students should 
receive during orientation and the orientation methods . This was used 
in making revisi9ns in the orientation program. 

The weekly LC questionnaire and taped discussions were of limited u^e be- 
caase they were immediate^ often emotional, reactions to the problems LCs faced 
during orientation. Thus, while they may identify some problems, they do not 
go far in suggesting viable solutions. 

Results 

1. Orientation procedures were documented only shortly before the opening 
of FWS for the fall. Time pressures did not permit staff-development 
workshops that would explain to the instructional staff the underlying 
concepts of the newly written procedures and that would prepare the 
LCs to implement the procedures effectively. Instead, the procedures 
specifications were distributed to the instructional staff and informal 
group meetings were held by developers to clarify the procedures^. This 
method proved inadequate for two reasons: (1) procedures were somewhat 
complex; and (2) only one member of the instructional staff had any pre 
vious direct experience with FWS students (the FWS director had been in 
the program only one month; one of the three LCs was newly nired aiid 
had received li'ttle training; another LC had served in a noninstru6tion- 
al capacity within EBQE the previous year). As a result, the procedures 
were but partially understood by FWS staff and nd't fully implemented ac- 
cording to plan. ^ 

2. There were fewer resour;^ces available for use by students than planned. 
Substantial staff efforts spent in planning and curriculum development 
reduced the manpo^ available for developing resources. Some resources 
were developed but not yet written into guides; policy at that time pre- 
cluded the use of a resource before its guide was approved. 

3. Two resource-organization Orientations were scheduled for early in the 
second week; career explorations followed immediately for some students. 
The orientations .jnd explorations qame too early for the students to as- 
similate. There was insufficient time between orientat;ions and explor- 
ations for' student/LC feedback. 

4. Based on the review of a sample of student files, students did not 
complete most of the orientation objectives; that is, most fell short 
of the expected performance in program planning, use of resources, ef- . 
ficient scheduling of time, and project planning. 

5. From the questionnaires and interviews (both using somewhat biased 
student samples) several results were obtained: 
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° The most frequent complaint (made by approximately 65% of the stu- 
dents) was that testing came during the first part of orientation 
and that too many forms were required^ At least four reqommenda- 
tioqs were jnade that the purpose for both tests and forms be more 
clearly explained and that more help be given in'^assisting stu- 
dents in completing forms. 

° Students generally felt that the orientation had helped them ad- . 
just to the freedom they have in EBCE; the two activities they 
listed as most responsible for this were their visits to resource 
persons and tfTeir work with LCs. 

Students reported mixed feelings about the^ir RP and RO visits during 
orientation. Students said RPs were^far more interesting and in- 
formative than ROs. (On a 7-point scale from "very boring" to "v^y 
interesting," all but three students. rated RPs. above the midpoint.) 
ROs received ratings evenly split above ^nd below midpoint. Stu- 
dents reported there were not enough RPs'Jn e.nough differ,ent cate- 
gories to satisfy their needs and 'interests. About five students 
said they wished they had had more help in locating and using RPs 
duriag orientation. 

° Most.students (about 80%) were pleased with the help they had re- 
ceived from their ICs during orientation- They indicated that this 
interaction (both in groups and individually) gave them whatever 
understanding they had of the program. 

^ Most students (about two-thirds) responded that the orientation was 
too long. 

^ ° Many students 'asked for more help in understanding planning, requvre*- 
ments, credit, grades, program forms, use of resources, EBCE staff 
functions, and use of the EBCE library (75% asked for at least some 
help understanding at least one of these areas). 

6. Following orientation in September, a questionnaire was, administered to 
13 members of the instructional and development staffs. The respondents 
were asked to assign relative priorities to various FWS orientation ac- 
tivities. Twelve items (listed below) received ratings of "top priority 
by nine or, more of the 13 respondents. Following each item is an in- 
dex which indicates the ratio of experience-based to FWS-based activi- 
ties. For example, the index (2/11) indicates that 2 respondents felt 
the process would best be accomplished through practical experience and 
n thought FWS-based activities would be a better means of accomplishing- 
if.* ■ ' 

a. Students should learn information about*the goals and objectives 
of the program. (0/13) 



*If the two numbers add up to more than 13, this means a respondent mentioned 
two methods for that item. 



b. Students should learn informati on-about graduation requirements. 

(1/13). 

c. Students should be able to develop semester goals and plans. 
(1/12) 

d. Students should be abl^e-^to develop project plans including ask- 
ing* initial questions, seeking resources, and stating project 
goals and 9bjectives. (7/10) 

e. Students should learn about the kinds of resources available 
in this program and be able to locate and use them. (7/8) 

f. Students should be able to ask the right kinds of questions when 
visiting RPs. (6/9) 

g. Students should know what participation in the program means and 
sant:t^ions for nonparticipation. (1/13) 

h. Students should learn the purpose of forms in this program, 
(0/13), ' 

i. Students should be able to plan and manage their time, (4/10) 

/j. . Students should know the importance of long-range plans and know 
how to approach the problem of long-range planning, (2/12) 

k. Students should be able to complete weekly schedules and weekly 
activity summaries. (2/12) 

1. Students should know how their worl< wilt be evaluated and credit 
assigned. (3/11) ' • 

^ The questionnaire asked for methods of instruction that would most likely 
^ accomplish the orientation goals. Xhe response showed that the staff 
felt interaction with the students a't FWS is the most effective way to 
accomplish the teaching and learning. 

Conclusions 

There emerged three general recommendations for modification of the pro- 
cess of procedures* development: (1) all procedures should be preceded by con- 
cept papers which outline the underlying theory and give the rationale for the 
statecl procedures, (2) procedures should be thoroughly reviewed by instructional 
staff during the development period, and (3) all procedures should be accompa- 
nied by an appropriate set of training materials to prepare staff in the use of 
the underlying concepts and the procedures. These recommendations were incor- 
porated into the development process. 

Specific to orientation, several actions were taken as a result of the 
evaluation findings: (1) a concept paper for futune orientation (and guidance) 
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of students was prepared; (2) the orientation procedures were revised and recdn- 
strujcted around this concept paper, with input from the FWS instructional staff 
sought during reconstruction of the procedures; (3) intensive staff develop- 
ment sessions were held during the last two weeks of August, during which time 
the instructional and development staffs thoroughly discussed the implementa- 
tion of all student-related procedures; and (^<) the orientation objectives were 
reassessed in view of the 12 priorities mentioned on the previous page. The 
orientation period was restructured to begin with a series of FWS-based acti- 
vities gradually expanding to resource-site activities. Students are encouraged 
to work at their own paces to fulfill the set of ori^ation objectives* Re- 
turning students'are invited to serve as teaching* assistants and workshop leaders 
during orientation* 

jte^ responsibility for resource development and maintenance has been trans- 
ferred from the FWL-EBCE development staff to the FWS staff. To accomplish this, 
a new position of resource analyst has been added to the FWS staff. This person 
has primary responsibility for developing and maintaining the resource pool. 

The requirement that a comprehensive guide be prepared on, and reviewed by, 
a resource bpfore contact by students has been dropped. This will eliminate any 
delay between resourp'e development and usage (complete guides will be prepared 
after initial student Contact). 

Student Guidance Procedures 

Preliminary Specifications 

The student guidance system that underwent preliminary testing in the 
Experience-Based Career Education program at Far West School incorporates a 
broader range of functions than is usually associated with the term "guidance." 
At Far West School, student guidance is fused with instructional functions and 
designates the full set of staff and student activities associated with person- 
alized student program planning and management. Traditional guidance functions-- 
helping students learn about their own interests, abilities, and values; helping 
them integrate what they know about themselves with available information ab^-Jt 
career and educational opportunities; and helping them learn to formulate long- 
range goals and plans for achieving them--are central ta th^ ir\structional 
staff *s daily interactions with students. Planning and managing individualized 
learning activities, monitoring progress, helping students integrate their di- 
verse learning experiences in the community into a coherent educational program, 
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and providing adult dired^on and support. are essentially gui dancer functions. 
This fusion of instructi^njand guidance is a natural outgrowth of the key as- 
sumptions and objectivesih^erlying the F^r West Laboratory's Experience-Based 
Career Education (EBCE) model. 

Program Planning . Program planning procedures serve three general pur- 
poses: 

1. to function as learning activities through which the student develops 
his decision-making and problem-solving capabilities; 

2. to ensure a purposeful, goal-oriented program satisfying the student's 
educational needs and planned with maximum collaboration from him; and 

3. to provide FWS staff with the guidelines for organizing' and managing 
' a student's program. 

Progress Monitoring . Progress monitoring procedures comprise the continual 
supportive evaluation processes in FWS. The goals of progress monitoring are to 
provide the processes and instruments: 

1. to assess and record student growth; 

2. /to diagnose student needs and develop appropriate instructional stra- 
^ tegies; 

3. to increase the student's awareness of his own interests, abilities, 
and values. 

Integrative Support , Integrative support describes processes for helping 
the student coordinate his learning experiences; that is, to a'ssis^ the student: 

1. to clarify and consolidate his experiences; \ 

2. to see the relationships among his learning activities, interests, 
needs, abilities, and values; and 

3. to make informed decisions concerning his current and future activities 

Evaluation Plan 

Two plans were designed, one for program planning and one- for progress mon- 
itoring. A test plan was not designed Vor integrative support because it was 
felt that judgmerj;;^^ ab^t the extent to which integrative support occurred coulcl 
be made from the data collected ^nder the other two plans inasmuch as the impor- 
tant aspects of integrative support take place in the processes of program plan- 
ning and progress monitoring. 
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The two test plans were based on intensive evaluation of planning and 
progress records from students' files. However, it was discovered that much 
information critical to the plans was missing from student files or was in- 
complete: Project Sketches, Project Plans, Resource Person Contact Reports, 
and other documents necessary to evaluate the procedures. Inasmuch as the 
files did not adequately reflect students' programs, the test plans were modi- 
fied. Under the modified plans, a sample of 15 students, five from each 
learning-coord^'natof group, was selected randomly. A midsemester file review 

ind an end-of-semester file review were conducted using this sample. In ad-, 
ition, a midsemester questionnaire about program planning was given to a group 
f students, and three students were interviewed at spring semester end. 

Midsemester File Review . The midsemester file review (in late April) was 
a first attempt to ascertain the completeness of stud^ts' files: the number 
and completeness of Project Plans, the presence of Long Term Plans, and so 
forth. This review included both learning coordinators* files and central .stu- 
dent files. All but one of the 15 students had-filed Long Term Plans. How-, 
ever, there were only 15 Project Plans (these were the work of seven of the 15 - 
, students) and only seven Resource Contact Reports, Learning coordinators re- 
ported that other plans, and perhaps other Resource Contact Reports, were in 
existence (in students' own notebooks or elsewhere); it was not knov/n how many 
or in what stage of development. ^ 

Midsemester Student Questionnaire . A questionnaire was designed (Exhibit 
5-A) to elicit comments from FWS students about their understanding and reaction 
to program planning procedures /forms (especially long-term planning). This was 
•distributed at an all -student meeting and returned immediately after completion. 
Twenty-two students present at the meeting completed and returned the question- 
naire. 

End-of -Semester File Review . After the spring semester ended, the files 
(both LCs' files and central student files) of the 15 students were again re- 
viewed, this time more thoroughly. They were checked for numbers and complete- 
' ness of documentation, and some ratings (e.g., the adequacy of goals and objec- 
tives on Project P-lans) were made. 

End-of-Semester Interview . At the end of the spriTig semester, three stu- 
dents (one from each LC group) were interviewed. An interview schedule was de- 
signed (see Exhibit 5-B) but the interview^ usually took the form of an informal 
talk with the student about his spring semester program. The schedule of 
questions served as a checklist of areas to cover in the interview. As a re- 
sult of this procedure, the interviews .did not focus on the same topics with 
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EXHIBIT 5-A 

HIOSEHtSTtR STUDENT (XJ£ST<^NA1^£: PROGRAM PlAftHlHG PROCEDORtS 



Instruct tons ; By inswrfng these questicns honestly ind sptclfJc*lly (giving exinples where ippropriitt). you will 
bflp us issess th« usefulness of stu<Jtnt progr*« planning procedures and thereby help revise these P^cf^^jcs /o^ 
future y«*rs. For quettlonj reUted to forms, you will find i copy of the fom <t the b*ck of the questionnaire. 
When the questions isk for suggested i*<)rove«ents on the foms. pleise feel free to iwrk on the copies provided. 

1. Whit Is ycur undtrs tending of the loog»tenn pUnnlng process U FWS? Pleise expi^^n how this process works. 
In your own words. Be sptclflc. 



2. Why do you think >(js ask you to go through this process at the beginning of each semester? Be specific In ycur 
reasons. 



3. Would you say It 1$ reasonable to expect FWS students to make long-tern plans at the beginning of each semester? 
Yes [ J No t ) State why or why not. 



4. Look over the long Tern Plan provided. Old this for» help you ©ake long-tem plans? Yes [ ] No [ ] 
Why or why not? 



5. What suggestions do you have for laaprovlng this fon»? 



6. Which way do you think would give you better Long Tem Plans? 

I working on then by yourself 
working on them with another student 
working on the* with your learning coordinator 

working on them In a swll group of students with guidance frOfiyour learning coordinator 

7. Has your Lono Tenu Plan helped direct your progran ^or the Sfwester? (Has It been a ""roa4 map* for you?) 
Yes C ) No f ] 

8. What were the best aspects of going through the long-tera planning process? 



9. What were the worst aspects? 



10. Did the External Course Description help you plan your prograw? Yes t ] No [ ] 1 didn't need to use It [ ] 
Any siiggestions for improving It? 



11, Did the Physical Education Plan help you plan your prograi? Yes [ ] No t 1 Any suggestions for laprovlng 
the for«? 



\Z. What Is a project? 



U. In yo^r o«n wordi, explain how to plan a project at FWS. 



I*. Has this Process helped you Plar) and coti>l<jte your learning activities? Yes [ 3 No [ ] Why or why not? 
specific 



5. Would you prefer wore or less structure In overall program planning? Explain and give exi*pTes, 



16. Doe. th'' weekly Activity Schedule help you linage your tlK? YeS t 1 Hot) Why or why not? Be specif k. 



\? Any suggestions for lifiproving the Weekly Activity Schedule? 



i« Any other cOBwents you wish to »ake about progr^ift planning at FnS? 
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EXHIBIT 5-B 



INTERVIEW QUESTIONS: END-OF^SEMESTER STUDENT INTERVIEWS 



Long-Term Program PTanning 

What were your main activities during the past year? 

How did you conie to be involved with these activities? 

When in the semester did you decide to do these activities? 

How' was this decision made? Did you work closely with your LC? How 
much direction did he give you in this decision? Did he tend to tell 
you what you needed to do or did he help you decide what you would do? 
How? 

V Were your activities this past semester related to your long-range ^goals 



and plans? ' ; 

What were your long-range goals at this time? Did-you have any? Were 
they vague or clear? 

Do you think there is any need for a person your age to have long-range 
goals? Why? 

Did anything you did this past semester help you evaluate your long- 
range goals in any way? How? What was the outcome? How did your LC 
help you in th.is process? ^ 

Do you think there are other things your^LC could have done to help you 
establish your long-rang? goals? To plan your semester program? What? 



Project Planning 

What do you feel was your most successful project this past semester 
' (the most fun, learned the most, gained the most credit, etc.)?/ Why? 

How did this project come to be? , 

Was it related to a career, a subject, an issue, or something else? 

> 

How did you go about plannina this project? . ^ 

Did you have an RP or RO orientation first? With whom? 

How did you prepare fpr the orientation? What kinds of questions were 
you seeking to answer' through this orientation? How did you arrive at 
them? Did your LC help you prepare for the orientation? Did he help 
you decide on some questions to answer? 
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every student. Ror example, one student had a very productive experience with 
one particular RP; the talk centered on that experience and did not therefore cov- 
er attitudes toward planning, as did the interviews with the other two students. 

Results 

Student responses on the Midsemester Student Questionnaire revealed less 
than clear understanding of the long-term planning process and of the project- 
planning process. Some students did not understand the concept of a project. 
It is possible that some students did not try to communicate their understand- 
ing on the questionnaire.' 

The end-of-semester fi^le review was intended to judge the adequacy of 
project planning. A summary of findings follows: 

1. Long-term planning did occur. It appears that a process took place 
whereby early goals were refined or made more specific, some goals 
were deleted, and other goals added* However, according to the 
questionnaire and interview results, many students did not have a 
very complete understanding of the long-term planning process. 

2* The evidence of implementation of the short-term planning procedures 
is less encouraging. According to the records, students (the 15 in 
the sample) planned an average of only 1-1/3 projects each. Students 
may well have completed more projects than this, but no records or 
documentary evidence was found. • 

As a rule. Project Plans were below program standards and often did 
not conform to the definition of a project* Nearly one-third of the 
20 Project Plans in the 15 students' files were unrelated to semester^ 
goals. Four plafi^ specified no goals- and objectives and only six 
plans were judged to contain enough infonnation to enable the student 
and his learning coordinator to know when the student accomplished 
his objectives. Seven of the plans had gotten into the files without 
the learning coordinator's approval. The level of inquiry reflected 
in many of the Project Plans tended not to be very substantial; the 
questions posed by students, and the goals and objectives, tended to 
be superficial. In many instances, it looked as though the student 
filled ojt the forms simply because it was required--wi thout careful 
thought. 

3, The assessment of progress monitoring is similar to that for short- 
term planning. For example, the fact that only six of the 20 
Project Plans bore sufficient information to enable determination of 
accomplishment of objectives is an indication that progress monitor- 
ing was not always complete* 

These observations suggest that the prescribed planning process did not 
always occur, but most students did engage in some activities related to some 
of their semester goals. The data may reflect, as well, undocumented mid- 
semester changes in semester plans. But the actual quality (as well as quantity) 
of students* projects is below program standards as reflected by the relation- 
ship to. sketches and investigatory questions, the adequacy of statements of 
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what the student was trying to accomplish, and the adequacy of proposed methods 
of evaluation. On the other hand, the fact that seven of the plans did have 
goals anfl objectives that followed^ from investigatory questions and that six 
of the plans clearly provided enough information to enable the student and 
learning coordinator to determine when the student accomplished his objectives, 
suggests that the prescribed process was feasible. 

The three end-of-semester student interviews (May 1974) divulged several 
problems, all consistent with other information previously mentioned. The 
problems include: (1) a lack of understanding by some students of the plan- 
ning process; (2) occurrences of inadequate progress monitoring, including in- 
sufficient feedback of progress information to students; and (3) occasions of 
inadequate use of information acquired through progress monitoring to solve 
problems in students' programs. One of the three students showed considerable 
growth related to a number of program objectives. It was clear that help given 
this 'student in planning and completing his program was effective. This inter- 
view substantiates the fact that the prescribed guidance processes can and 
sometimes do occur. 

The students who were interviewed indicated that they did not receive 
very much feedback about their work; two said they would have liked more 
feedback while working with resource people. One reason this did not occur 
•is that learning coordinators did not contact resource people very often. This 
meant that students did not receive adequate feedback and troublesome situa- 
tions (such as students having difficulty relating to a resource person or 
needing certain skills in order to complete a project with-a particular re- 
source person) sometimes remained unresolved. 

Conclusions 

The main finding was that the procedures were inadequately implemented, 
not that they were ineffective. When irrplemented, the procedures led to 
positive results. Five actions were recommended as a result of the evaluation: 

1. more complete documentation of the procedures for student guidance; 

2. intensive staff review of the concepts and procedures of student 
guidance; 

3. staff training in the skills necessary for guidance procedures imple- 
me)itation; 

4. mutual program staff (development, FWS staff) agreement as to the 
priority of tasks for learning coordinators followed by the elimina- 
tion/reassignment of tasks of low priority; and 
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. 4. Were' there discernible differences in the performance of students 
by groups defined by grade level, sex, or LC assignment? 

To answer these questions, diverse information collected through the formative 
process is aggregated and presented belOw: ^ 

Student Proj ects , "T^ 

Description . Each student's learning program is planned, focused, and 
documented by student projects. By monitoring student projects, FWS staff 
assures that each student is engaged jn purposeful , planned, and documented . 
learning activities. These activities are individualized according to stu- 
dents' interests, needs, and abilities; they are also intended'to help stu- 
dents achieve broader learning-package and EBCE program goals. 

Student programs at FWS ideally>would involve the studpnt in several 
individualized learning projects each semester. These projects would be 
supplentefited by additional basic skills work planned by the student and the 
FWS skills specialist as. an outcome of student diagnosis or student request. 
The program coujd include one outside course from a high school, community 
college, or other community agency. Finally, the program would include a 
student-planned program of physical education. 

At FWS, it is. intended that the students spend at least one-hail f their 
time in learning-site experiences with resource persons (RPs) or resource 
organizations (ROs)'. Student V^ojects are required by the model design to 
include extended involvement with an RP or RO and to include objectives, 
related to career development. 

Though the design prescribes that student projects must include Explora- 
tions with RPs or ROs, in practice the inclusion of these experiences in pro- 
jects was not always possible. There were not always RPs or ROs available in 
every area of interest which a student might wish to pursue. For example, one 
student doing a project on human evo]utiort -used the Lowie Museum of Anthropol- 
ogy, a community resource, but could not locate an RP with whom she could 
pursue her study.* Some students are initially hesitant about meeting and 
working with an unknown adult in the community. Such students w»re allowed 



*Thfs proved to be a persistent but not unexpected problem., Thus the staff 
encouraged students to develop their own RPs when necessary. 
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to work on projects, outside courses, or other supplementary activities, not 

requiring such personal contact, while staff at the same time encouraqed theiii ' 

to visit RPs or ROs for Orientations. The aim was" to find a suitable RP who 

would motivate the student to estaMish a learning relationship with a working 

adult. . / , ^ . ■ - 

' . • • ■ ■ • ■ ' / 

Analysis of Students' Performance . Learning coordinators (LCs) were asked 

to identify for each studen\the number of projects completed* and/, o^f those 

completed, the number that included a career Exploration lasting at least ten 

hours with an RP or RO. The distribution of the number o,f projects completed 

by students each semester is shown in Table 5^3. ' \ 



^ , TABLE 5.3 
COMPLETED PROJECTS BY SEMESTER 



Number of Students 
• Completing Indicated 
Numbers of Projects 


Number of Projects Completed 


0 


1 


2 


3 


4 . 


5 


6 


Total 


Fall 


•7 


7 


'8 


15 


14 


3 


1 


55 


Spring 


5 


- 9 


12 


11 


11 


0 


0 


48 



In. the fall a total of 145 projects were completed by 48 students. Of 
these projects, the LCs reported that 72 (50%) included experiences with RPs or 
RQs of at least ^ten hours. However, the data also show that seven students 
completed no_ projects and that six other students had yet to complete projects 
containing Explorrations with RPs or ROs.*^ At the end of the first semester, 13 
of 55 students had yet to work with an RP or RO for a significant period of 
b'me. !' ' r 

In the spring, 110 projects were coinpleted by 43 students. The LCs 
indicate that 77^(70%) of the projects provided the students at least one 
resource Exploration. Five students failed to complete any projects durijig 
the spring. Additionally, two students who completed only' one project each 
during the spring did not include, an Exploration. Thus, I of 48 students 

*A project is counted here a. completed if it was sufficiently complete to 
receive OPS credit under the system described on page 174. . \ * 
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did not complete a resource Exploration during the spring. Table 5,4 shows 
the distribution of projects completed by students for the entire year, A 
significant point to be not^d is that only one student completed the school 
year without finishing at- least one project*; this student was also the only 
student not having at least one resource Exploration during the year. The 
median aumber of projects completed by a student was five. 



TABLE 5.4 . 

NUMBER OF PROJECTS COMPLETED BY FWS STUDENTS DURING THE ENTIRE YEAR 









Number of Projects Completed 










0 


1 


2 • 


3 


4 


5 


6 


7 


8 


9 


10 


Number of 
Student^ 


1 


Z 


3 


6 


8 


C 

8 


8 ■ 




5 


2 


1 



Referring to Table 5,5^ in the fall veteran students averaged almost one 
more project per student than new students. In the spring, both groups of 
students had siipil^.r means. > 

Table 5.5 reveals two significant situations that require explanation: 
(1) fewer projects were completed per student in the spring semester than in 
the fall semester, although more credit was earned; (2) vqteran students 
(Group A) slumped badly in their spring semester performance. In discussing 
with LCs performance of students in projects, it was apparent that the LCs 
had increased the leveUof planning and performance required in student pro- 
jects as their students \gained program experience. For example, data previous- 
ly presented show thatythe percentage af projects containing resource Explora- 
tiojT^ Increased from 50%TrKthe fall to' 70% in' the spring. One LC, in fact, 
did require every project unWrtaken by his students to^contain a resource 
Exploration. One result of tim increase in project quality was a decrease in 



^Several' students with low levels of activity in the program durinti the fall 
semester dropped from FWS and are not included in these totals. The data on 
the one student returning to FWS after a one semester's absence have also 
been deleted. Thus the numben of students completing the entire year is 48, 
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the overall number of projects through the elimination of less meaningful pro- 
jects anowed in the fall while students were adjusting to the EBCE "learning 
process. Thus, from Table 5.5, the mean^ number of projects completed during 
the semester by first-year students in the program (Group pBC) decreased 
slightly from fall to spring (from 2.4 to 2.2) although their mean credits 
earned rose markedly (from 2.2 to 2*9). 



TABLE 5.5 

PROJECTS COMPLETED AND CREDITS EARNED BY VETERAN AND FIRST-YEAR STUDENTS 





N 


r 

Number of Projects 


Credits 


Group 


total 


Mean 


Total 


Mean 




Fan 


Spring 


Fall 


Spring 


Fall 


Spring 


Fall 


Spring 


Fall 


Spring 


Veteran 
Students 


14 


11 


47 


22 




2.0 


38.5 


24.5 


2.8 


2:2 


. First-year 
Students 


41 


.37 


98 


81 


2.4 


2.2 


89.0 


110.0 


2:2 


2.9 



The slump in spring performance of veteran students is simply explained. 
All but two of these students were graduating seniors. Most needed few*^redits 
to graduate; many ta'ilcred their program activity to meet only their minimum 
requirements. One of the two juniors had accumulated such an excess of credits 
in past semesters that she, too, would graduate under a normal level of activity. 
This she elected not to do and sharply decreased her program activity in the 
spring so that she could continue in school next year. A complete discussion 
of the amount of credits earned by students during the year is presented 
later in this section. 

Students' Program Activity 

Description . The major source of quantitative data on student -participa- 
tion and program activities was the Student Activity Report (SAR) (Exhibit 5-C). 
The SAR is a weekly report on activities completed by the student. The 
students* task is to enter brief descriptions of all activities in which he 
engaged and to enter appropriate hours for each activity. The SAR is divided 
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EXHIBIT 5-C 



- f.an uoGst school > student activity report 


Studen 
LCs Na 
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mo 


Week of 
LC's Sign 


(from) (to) 
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section a Coding: 


s:v;-|:v LC :;:;;;;;:;r.:;:|:5;;" 




LEAVE 

Dl AMI/ 


LEVEL 


TYPE OF 
RESOURCE 


NO. 
HOURS 


PROJ. 
NO. 


PKG, 
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NAME OF RP, RO, CR 
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TOTAL HOURS: RP ; RO CR 

■ • • ' 7 ' ' , 

No. of Hours spent in traveling to aiTci/or from Resource Sites 
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student Activity Report (continued) 
•SECTION- B r 

Enter total number of hours NOT recorded in Section A spent in reading, researching, 
or preparing project products (e.g. ,'>eport writing, recording, painting, etc.) 



LEAVE 
BLANK 


NO. OF 
HOURS 


PROJ. 
NO. 


PKG 
NO. 


ACTIVI-TY DESCRIPTION , \ 

_ — U 










■ A- 








\ 
































TotaT 
Hours 




t 



SECTION C 



LEAVE 
BLANK 


NO.HRS. 
SPENT 


FAR WEST 


SCHOOL CENTER ACTIVITIES 








Individual meetings with Learning Coordinator 






Advisory group sessions 






Rap & Other sessions 


1. 








(specify) 


^ 

2. 








3. 






Testing 






Workshops (specify) 


1. ' 








2. 1 






Tutoring for yourself 


1. 








(Tutor's name/subject) 


2.- 






\ 


Tutoring others 


Total 
Hours 










SECTION D 








LEAVE 
BLANK 


NO.HRS. 
SPENT 


"OTHER" ACTIVITIES 






High schbol course or class 






College course or class 






Physical education activities 


Total 
Hours 
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into four sections of which the first, Section A, covers the use of external 
resources. Students list each resource contacted, indicate type (RP^^RO, 
and^show the number of hours spent at the resource. Section B accounts- for 
time spent in individual activities related to projects, such as reading, 
research, and report writing. Section C covers activities within the FWS 
Center, such as group and individual meetings, workshops, ^nd tutoring. Sec- 
^ tion D covers external classes and physical education activities. 

Students were asked to fill out .the form on Fridays. The form takes only 
a few minutes to complete; most information is available on a weekly schedule 
on which the student has previously planned his activities for the week. The 
student's learning coordinator signs the report and it is then placed in the 
Student's fi*le.- 

Analysis of Students* Performance . Participation by a student in FWS 
should require at least 25 hours per week, the same as , that required of a 
student in OPS who aims to graduate on schedule. Examination of the Student 
Activity Reports for a typical eight-week interval during the first semester 
and for the entire 18 weeks of the second semester revealed the information 
in Table 5.6.* 



TABLE 5.6 

WEEKLY PROGRAM ACTIVITY REPORTED BY STUDENTS 



' - — i 

Number of Students 
Reporting Activity in 
the Indicated Interval 


Average Weekly Time Per Student 
(intervals in hours) _ 


p-9 


10-19 


20-29 


' 30-39 


40+ 


Fall 


8 


8 


14 


13 


12 


Spring 


3 


6 


21 


13 


7 



The median during the fall of weekly hours reported by students on the 
SAR was 28 hours. The table indicated that in the fall, 14 students (out of 
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*Though the source of this information is the students and thus might be 
subject to some exaggeration, the time reports are approved by LCs before 
submission and should be reasonably accurate. 
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55) reported average weekly activity within five hours of the desired 25; 25 
students reported average time considerably in excess (30 or more hours); and 
16 students reported considerably ress time (under 20 hours) spent in program 
activities than desired* 

In the spring, the median of weekly hours reported by students was 27. 
Table 5.7 indicates that 21 students (out of 50*) reported average weekly 
activity within five hours of intended 25; 20 reported average time in excess 
of 30 hours; nine students reported considerably less time (under 20 hours) 
in program activities'* than desired. 

Conff^yiering that by the end of the year some 41 of 48 students were 
participating at least close to or well above the desired level of 25 hours 
weekly, it would be expected in terms of the model design that the level of 
resource involvement desired (12 hours weekly, or 50% of student time) would 
also be met by most students, but this was not the case. The data for fall 
and spring periods are shown in Table 5.7. 



TABLE 5.7 

TIME SPENT AT RESOURCE SITES AS REPORTED BY STUDENTS 





Average Weekly Time with RPs or ROs 


Semester 


Returning 
Students 


First-Year 
Students 


All 
Students 


Fan 


7.5 hours 


6.3 hours 


6.5 hours 


Spring 


7.] hours 


6.1 hours 


6.4 hours 



Using ten hours as representing an acceptable level of weekly activity 
at resource sites, and four hours as an unacceptable level, the distribution 
of students may be seen in Table 5.8. In the fall, 19 students reported 
adequate time at RPs or ROs; and of the other 36 students, 18 reported spend- 
ing fewer than four hours weekly at resource sites. Reporting was similar in 

♦Information is presented on 50 students; only 48 of these completed the 
spring semester.. 
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the spring; nine students reported adequate time with resources, and o'f the 
37 other students, 19 reported spending less than four hours weekly at resource 
sites. 



TABLE 5-8 

WEEKLY STUDENT ACTIVITY AT RESOURCE SITES BY GROUP ^ 



Level 


Veteran Students 


! 

First- Year Students 


Total 


Fall 


Spring 


Fall 


Spring 


Fall 


Spring 


Acceptable (over 10 
hours per week) 


4 


2 


15 


r 

7 


19 




9 


Low (between 4 eyid . 
10 hours per week) 


6 


4 


12 


14 


18 




18 


Unacceptable (under 
4 hours per week) 


4 


5' . 


14 


14 


18 




• 19 



At the end of each semester each LC was asked to rate each student as 
either high or low (high = 2; low = 1 ) in the usfe of external resources (RPs, 
ROs, CRs). Each of the three LCs rated all students; the average of the three 
ratings was assigned to the student {i*e., students were rated high if at 
least two LCs rated them high; they were rated low if at least two LCs rated 
them low.) The level of agreement between LCs' perception .of students' usage 
of external resources and the students' own reporting of resource use (via SAR) 
is shown in Table 5,9. Note that each student self-reporting at least ten 
hours weekly activity with resources was perceived by LCs as a "high user of 
program external resources," However, 23 of 37 students reporting fewer than 
10 hours week'lj^^ resource activity were also judged by the LCs a$ "high' users 
of external resources." Two explanations are plausible: (1) many students 
report via the SAR less time than they actually spend with resources, or (2) 
12. hours weekly was an excessively high target figure for student-resource 
interaction as the model was implemented— LCs viewed less resource activity 
as ^satisfactory. Examining individual SAR reports reveals cases substanti- 
ating the first explanation: many SARs were submitted with incomplete data* ^ 
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The second explanation will form a hypothesis for the Performance Test during 
the 1974-75 school year. Data on students' activity will be collected during 
FY75 and the- expected level of resource uSage reassessed. 



TABLE 5.9 " 

EXTERNAL RESOURCES: COMPARISON OF LC RATINGS WITH STUDENT REPORTS 



LCs' Rating of 
Students' Use 
of R^esources 


SAR Weekly Means of Resource Usage 


10 hours 
or more 


Less than 
10 hours 


High 




9 ■ 


23 


Low " 


• 


0 


14 



Credit Earned 

Description . A combined performance- and time-based system for assigning 
credits to students has been developed by FWS an.d approved by the Regional 
Superintendents of the Oakland Public Schools. When a student has completed 
a project, he and his learning coordinator fill out a Student Project Summary 
Report. last part of this form asks them to request the amount of credit 
and the subjectTrea. Together the student and learning coordinator reach an 
agreement and record it on the form. The Summary, the Student* Project Plan 
and any supporting evidence are then submitted to the FWS director for final 
approval. He reviews these items and either approves the credit or consults 
with the student and learning coordinator if he .disagrees with the credit 
assessment. Whenever there is doubt or continued disagreement about credit, 
the FWS director will call for a meeting between himself, the OPS admin'istra- 
tive liaison, the skills specialist, the. student, and the student's learning 
coordinator. Together they will reach a decision. If there are cases where 
a learning coordinator and student are unable to agree on the amount or type 
of credit to be assigned, the FWS director will arbitrate. If no agreement is 
reached, the group will be convened to. decide. To ensure that students do not 
put off completing all projects until the end of a semester, thereby placing 

. < ..V 

t ■ * t 

174 



a burden on the director who might then be required to review as many as 300 
• projects, students may submit in advance a maximum of two projects in any one- 
month period for credit assignment. 

Analysis of Student Performance . Table 5.10 shovvs the distribution of , 
credits earned by FWS students in the fall and spring semesters. During the 
^ fall, 55 students earned 127.5 credits, with a mean of 2.34 credits per stu- 
dent. From Table 5.5, page 16^, veteran students averaged .58 more units of credit 
earned than new students during the fall semester. In the fall, veteran stu- 
dents exceeded 'the norm of 2.5 Oakland Public Schools (OPS) units of credits; 
new students fell below the nbrm.* 

During the spring, 48 students earned 134.5 credits, with a mean of 2.80 
credits per student. However, Table 5.10 also shows that the group of first- 
year students (Group OBC) increased their mean credits earned sharply to 2.97 
during the spring semester. Notice that 17 students earned an abnormally high 
4.0 credits. This likely represents relvard for full completion of projects . 
started during the previous (fall) semester'. 

Table S.llshows the distribution of credits over the ent.re year for the 
48 students completing the year. The mean value for credits earne'd is 5.18, ^ 
slightly greater than the OPS expected value for a year of 5.00 earned credits.** 

Group Comparisons of Program Activity 

Description. Several variables have been suggested as having impact 
on the structure and effectiveness of student learning programs in EBCE. In 
particular, it has been hypothesized that older, more mature students should 
be more effective in planning/fulfilling projects, in interacting with RPs, 
and in coping with the considerable program requirements for student respon- 
sibility. It has also been suggested that there might be group differences 
in program. performance between males and females. Finally, an influential 
factor on studeQ-€s' performances is the LC; differences 'in LC program 

*ritudent in the Oakl"and Public Schools must earn 20 OPS units to graduate. 
To graduate in four years (eight semesters) the student must average 2.5 units 
per semester. The uypica'l semester class meets one hftur daily and earns the 
student 0.5 OPS units. OPS students typically are enrolled in five classes 
each semester. 

**Note that only one student failed to receive any credits over the year, the 
same student mentioned earlier who completed no projects. 
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TABLE 5.10 



DISTRIBUTION OF CREDITS EARNED 
BY FWS STUDENTS, FALL AND SPRING SEMESTERS 





Number of Students 


Fall 


Spring 


4.5 


0 


1 


. 4.0 


3 


17 . 


3.5 


8 


3 


3.0 


7 


4 


2.5 , , 


13 


n 


2.0 


11 


2 


1.5 


7 


3 — 


1.0 


3 


3 


0.5 


0 


1 


0.0 


3 


3 



TABLE 5.11 

DISTRIBUTION OF CREDITS EARNED, FULL YEAR 



Total OPS Credits Earned 


Number of Students 


8.0 


2 


7.5 


4 


7.0 


5 


6.5 


4 


6.0 


2 


5.5 


3 


5.0 


10 


4.5 


4 


4.0 


5 


3.5 


1 


3.0 


5 


2.5 


1 


2.0 


.1 


1.5 


0 


1.0 


0 


0.5 


0 


0.0 


1 
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philosophy and instructional methods might result in differences among LC 
groups in program performance. Table 5.12 aggregates m^an data by group: 
included are LC ratings of students' usage of external (e.g., RP, CR) and 
internal (e.g., workshops, tutors) resources, students' weekly reporting of 
activity (via the SAR), number of projects completed, and number of credits 
earned. Data on those students representing cases of limited participation 
for extra-program reasbns (e.g., few credits' needed for graduation) have been 
omitted. - . 



TABLE 5.12 
PROGRAM DATA GROUP MEANS ' J 



Measure 


■Grade Level 


Sex 


* Learning 
Coordinator 




10 


11 


1.2 


M 


F 


A 


B 


C 


LC's External Rating* 


1.60 


1.42 


1.82 


1.63 


1.60 


1.59 


T.67 


1.59 


LC's Internal Rating* 


1.56 


1.31 


1.56 


1.60 

> 


1.48 


1.45 


1 .62 


1 .58 


Weekly SAR (hours) 


7.40 


4.22 


8.60 


7.6^^ 


6.13 


4.97 


9.84 


5.98 


Credits (year) 


5.23 


4.35 


6.50 


5.67 


5.37 


■5.72 


5.81 


4". 44 


Projects (year) 


5.36 


4.92 


6. '08 


5.78 


5.19 


6.00 


5.85 


3.89 


N 


14 


12 


13 


21 


18 


17 


13 


9 



*High = 1; low =; 2. 



Analysis of Students' Performance 

Grade Level. As shown by Table 5.12 the group of twelfth-grade students 
has reported the most resource activity (via SAR); the same group has been 
perceived by the LCs as the highest (of the three grade-level groups) in the 
usage of external and internal resouijces. The Hnean number of projects com- 
pleted is 6.08, substantially higher than the means for the lower grade-level 
groups. The mean of credits earned by seniors is 6.50 OPS units, more than 
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one full OPS unit higher than either other grade-level group (OPS expectancy 
is 5.0 units per year). Clearly, as a group, the FWS seniors performed at a 
significantly higher level than the remainder of the students. However, this 
higher level of performance cannot be attributed wholly to greater maturity: 
sevej^of the 13 seniors were completing their second year in EBCE; only two 
non-seniors had a similar length of experience. It is expected that students 
wilY perform mre effectivel;' as their experience increases in the EBCE learn- 
ing process. Notice also thaft the means of the group of tenth;graders exceeds 
thos,^^ af the group of eleventh-graders on each of the measures of Table 5.12. 
All these students entered the program in fall 1973. From these data, there 
is no evidence to support a hypothesis that older- (higher grade-level) stu- 
dents perform more effectively in the EBCE program. 

Sex. The means of the group of male students in the EBCE program are 
higher on all measures of Table 5.12 than the means of the gtoup of females. 
However, t-tests performed on the respective group distributions show no 
statistical significance between them for any measure. Thus, although group 
differeTices by sex are observed (for example, the mean difference in credits 
earned between the groups is .30 OPS units, or three- fifths of a normal OPS 
semester class credit)', none of the differences is sufficient to substantiate 
any hypothesis concerning differential program performance by 'sex. 

LC Group. LCs* perceptions of students' usage of external resources and 
internal resources do not vary much across the groups (t-tests show differences 
not to be significant at the .10 level). However, the differences in means 
across the remaining variables (student-reported hours, credits, projects) are 
substantial. Students in LC-group C average only 4.4/1 credits, compared to 5.72 
and 5.81 credits for students in LC-group A and LC-groqp B, respectively. A 
t-test applied to the distributions of credits earned shows LC-group C signifi- 
cantly different from either other LC-group at the .10 level. , 

The lower number of credits earned by students in LC-group C is matched 
by a significantly lower number of projects completed by members of this 
group (the t-test reveals the distribution to be significantly different from 
the oV'er two LC-group distributions at the .10 level). -Students in LC-group 
C average fewer than four projects (3.89) while those students in LC-group A 
and LC-group B average close to six projects (6.00 and 5.85 respectively). 

. ■ i<r\ . 
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Surprisingly, reports of' resource usage by students in LC-group C are not 
the lowest of the,^groups. The mean of LC-group B is substantially the "highest, . 
nearly twice the mean of LC-group A, the lowest. The t-tfest reveals a signifi- 
cant difference (at the ..10 level) on this measuV;e between LC-group A and LC- 
,group B. * i , ^ • 

Further investigation of students' projects revealed another interesting 
fact: every project completed by students in. LC-group C contained a resource 
Exploration (student-resout'ce interaction of af least 10 hours in length); ap- 
proximately three-quarters of projects by students in LC-group B contain a re- 
source Exploration; Qne-h'alf of projects "'by students in LC-group A contained a" 
resource Exploration. Every student ..except one^ did" accomplish -at leas.t one re- 
source Exploration during the spring semester, howdven. 

Evi-dently, learning codrdinator C sets the most stringent standards for in- 
cluding plaoned, lengthy resource involvement in projects*," as a result, fewer' 
projects are initiated and completed by his .students. It appears that the credit- 
assignment mechanism has. translated these fewer projects into correspondingly' 
fewer credits. Learning coordinator B apparently encoi/rages a variety of shorter 
resource interactions as well as Explora'tio'ns" (thus his students report the hjgh- 
est resource activity).. Learning coordinator A'allows his students to plan pro- 
* jects without substantial resource interactions as long as each student has at 
least one prpject with an Explorati^bn (thus .students in LC-group A complete the 
.most; projects).' Thus, during' the. past year, /ther'e apparently were three differ- 
ing approaches to student guidance. - * . ' # 



Conclusions ^ 



The program was successful in stlmulatigg students to project activities. 
% the end of the fall semester, 48 of 55 students had completed at least orie 
project. As the -year progressed, Standards for 'project quality were 'increased 
by staff, projects became more purposeful, and t1ie number of projects under- 
taken by students 'decreased. Even so, 43 o>48 students- completed at least one • 
project in the spring. ' The mean number of projects completed.by students durjng 
the year was five; the range was from 0 to 10. Experience proved to_ be an impor- 
tant factor in student performance: returning students completed more projects ■ 
than new-s'tudepts; new students' spring performance was better, than in the pre- 
vious fall. ' . 
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. Moderdesign states that every project should involve at least one resource 
Exploration or Investigation. ' • ' ' 
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Students'' mean program activity was above the -establisjjied stan^rd of 25 , 
hours per week. ^Even so, most students were not spending as much t|me at re- 

".source sites as the model prescribed. Using students' own reports of thei^r'* 
act-b)ities, the'mean of student resource activity was 6.5 hours>.er week, well 
under the standard of 12.5 hours (50% of the students' program activity). 
Learning coordinators seemed satisfied wi th the amount of. student-resource ac- 
tivity; they rated 32 of 46 students as ."high users" of external resources. 
Of these 32 students, oaly jiirre approached or exceeded the 12.'5-hours standard. 
This is ari i.ndi cation that the standard for student/ resource interaction (50% 
of student time) is higher than is feasible. This question will be reassessed 

^4uring the next year^ ^fSee Operating PlanYY75 , page 77.) - , 

Students progressed towarsd^g-lraduation'satisfdctorily. 'The mean of credits 
earned during the year by students was 5.18, slightly greater than the OPS e:*!:- 
pected value of 5.0."" The .individualized nature of thfe program allowed motivated 
students abe opportunity to^accelerate their programs; 13 students earned 6.5 
or more credits. As would be expected, several stucients did not progress satis- 
factorily; nine^studehts earned 3.5 or'fewer credits during the year-. Addition- 
ally, one student returned to regular high school after the fall semester in 
wfrich he attempted no -learning activity. ' * * 

There was no statistically significant difference 'across measures of pro- 
gram activity (credits, number of jp]0^^Sy respurce activity) between males 
and females, or betvveen grade levels. There were significant differences in 
students' performance when grouped by learning, coordinator. TheUearning co- 
ordinators varied in their approach to student project planning, and the. dif- 
ferences were observable in the number of projects completed by their students, 
in the amount of resource activity reported by their students, and in the 
amount of credit received by their students. Intensive staff training/develop- 
ment sessions held in August 1974 are intended to standardize LCs* approaches 
to student guidance (see the evaluation of student' guidance, earlier in this 
chapter). The success of this training program in accomplishing a consistent 
Implementation is of primary concern to EBCE during the coming year. A major 
task of formative- evaluation during FY75 is centered* on this question. (See 

, Operating PTan FY75 , page 77.) ? . ' 
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Learning Packages^ ^ 

Wf ^ 1 . 

^ ^escriptvon 

Aneafnjng packag^e is'an assemblage of resource persons, resource organ- 
izations, and conmunity resources organized around a common set of package 
goals. The organizing principle may be a career area (suclvas conniierce), or. a 
competence or subject area (such as- science) satisfying both Oakland Public 
Schools (OPS) requirements and student 'interests. The package is designed to 
enable a student to ijdentify those learning r^esources avciilable to fulfill his 
^individual purpose in program pi anning^hether it^be to sati sfy* a tiigh sthoo! 
graduation requirement, to explore a c&reer area, or to investigate issues qf 
personal concerp*: The ^ack'age catalogues resources so" that the basic learning 
unit-^the project "Car\ be constructed. In general, each student's use of the 
package is unique since he incorporates different resources into his own pro- 
jects. ^ ' . ' 

A learning package offers the student a structured framework within which 
, to make decisions, plan his^own learning activities, and identify or develop 
perfomflri^ objectives he wishes to achieve as a result of his activities. The 
learning package also- provides staff wi'th a^set of package goals, of which all 
students pursuing projects through the package are expected to Achieve soine 
minimum set. The package goals serve as guides to leanning. coordinators in 
. assessing student projects, and- determining when they are complet-e and suff[- • 
cient in terms of the"package. The packege provides a mecharrism for awarding 
credit on .the basis of performance , as well as time. 

^ Students are required to meet package goals in. order to receive credit for 
their. projects. A student c&n complete more than one project in order to ful- 
fill the package goals and he. can take as/long as ne^cessary to meet them. In 
this way credit , assignment can be ba§ed on performance as well as time spent. 
All students meeting > the minimum package requirenents receive t'he same anraunt 
of credit/ Students seeking additional credit muSt megt additional goals. As 
the package concept evolved it became clear that it could serve -other purposes 
' basic to* the goals and philosophy of the Far West Laboratory EBCE program. For 
example, ♦school "staff had found that students were not always able to share their 
learning experiences and activi'ties in the advisory group meetings because too 
many rdi verse' experiences and activities were taking "place to interrelate.. 
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Learning coordinators suggested that a main function of packages ^be to form 
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discussion groups that could. relate individual student interests and learning 
activities to the .broad issues, concepts, and prob]enis of the specific package 
career/discipline area* , , 

In shorti learning' packages and the package discussion groups were de- 
s^igned to* be used in conjunction with the entire instructional system's* set of 
procedures to faci'litate implementation t)f those procedures, to' si mpl ify* pro- 
ject planning in subject areas' required by the Oakland public Schools, and to ' 
assure breadth of learning while providing mechanisms 'and a framework for plan- 
ning individualized^! earning activities. 

Evaluation of Package Concept 

The methoij of evaluating the^ackage concept was similar to that used in 
the evaluation of school procedures. First, several packages were assembled, 
documented, and'placed'in .use ^vithin the FW'S instructional system. Five pack- 
ages were assembled: Physical Science, Biology, Commerce, Communications- and 
Media, and Politics. A Test Plan for formative evaluation was 'then written. 
Data w^re collected and analyzed in accordance with the plan. Finally, a Form- 
ative Evaluation Report was published. The findings of this evaluation were . 
used in intensive sessions on staff development during the summer months and in 
revision of the packages for use in FWS during the 1975 school year. 

The following techniques for collecting data on package use were used 
during the spring semester. ^ / 

1. Learning package discussion groups were tape-recorded and the tapes 
summarized. 4b > 

♦ • " 

2. Resource persons and organizations were 'sent review copies' of packages 
in which they were listed. 

\/ 

3. Student files were reviewed at the end of the semester. 

4,. Students who partic1|lb'd in the packages were interviewed: 

5. Package coor*dinators (LCs) were interviewed at the end of the semester. 

Findings 

1. In general, early meetings of package discussion groups' were, wel 1 at- 
tended, ljut interest waned after a few weeks. Thcsgrdups did not ful- 
fill their anticipated role of interrelating the projects, activities, 
and interests of FWS students. Several reasons are Apparent: (1). the 
LCs designated as "package coordinators" often had new tasks (fe.g., 
student recruitment for fall) added to their already busy schedules; 
tasks considered low priority were perforce neglected— the infant. 



discussion groups felTin this category; (2) the LCs did not have a 
clear idea of* how to promote stujdent intereH in packages; and (3) . 
the* paperv/ork involved vh project planning was allowed to preempt" 
time better used for rap sessions. For each of the five packages, 
discussion-group activities, had ceased four to eight weeks prior' to , 
'the end of the Spring semester. ' ^ • \, . 

Resource persons and resource organiZcTtiohs were generally positive-* , ^ 
about the^ackages. One resource person offered severaT suggestion^: 
for modifying the format of the Communications and Media Package. 
Some comments were: "it [Commerce] is indeed a profound presentation"; 
"the [Biology] projects are well conceiv,ed"; "it [Commerce] is excel- • 
lent and' most complete"; "an excellent job [Communications ana MSdia]; 
well organized." * - 

FWS staff had varying opinions of the packages. They found the p^ck- * 
age sample projects very helpful in planning projects; but two of the 
four staff members (director, three iCs) did not feel the^projects 
helped in assigning credit to project^" or in monitoring student pro- 
gress. The staff seem to have used the packages primarily as a means ^ 

of cataloguing resourcgs. 

>. . . • * 1^ 

Students generally felt the packages helped in developing project^,. 
But only one-half of those interviewed felt that the packages stimu- 
lated* new idea^ or that they provided help inJ)asic skills. MosF 
students , agreed that the packages were helpful in relating careers to 
Subject areas. Most students^ also agreed that the resources ^contained in 
the packages were suffi cient 'to complete projects, and that the package 
structure clarif-ted the crf^dit assignment process;. . 

M.any students attempted package projects without a basic understand- 
ing of the package structure. For e;ii;amplie, seven students using pack- 
ages admitted they had not read #ny part of them; eight students ad- 
mitted that they had not read the credit-assignment section. 

There was considerable confusion about when a-,student was "in", a pack- 
age. Learning coordinators indicated that certain of their sjtuflents 
were working on package projects, yet those students said they>/ere 
doing independent projects, , Other students worked on projegt^S^that 
clearly related to existing packages. These stlidents shotitd have, de- 
veloped projects in accordance with the package ^goals and participated 
in package discussion groups, yet they- did not.\ 

The questions students posed in Project Plans were generally toncerned 
with .day-to-day aspects of the program, issue, or organization th^ 
were investigating, such as "How is the Berkeley Own-Recognizandi^Pro- 
gram run?" "Who supplies the money?" and "Where are the Legal /Aid 
•Offices located?" Some students did ask more probing questions^^ such 
as: "How powerful can a union be?" "Does a young person have as much 
•power as an older person in a union?" "What do you have to go through 
in order to press L^ape] charges? Is 'it worth it?" However, their 
project goals and objectives seldom -indicated^ how thgse questions would 
' be>.'answered. ' ' * 

# > V • 
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8. A comparison of individaal studeats' package Project Plans to non- 
package Project Plans revealed m significant differencesf in depth 
of questions asked or^in quality or adequacy of project gbals and 
objectives, Qual.ity of Project Plans completed^- varied according to 
. the ability of the student rather than according to whether a package ■ 
was used. Similarly, differences in quality of project products were 
apparent among students rather than between an. indivi dual student's * 
package and nbn-pack,age products. * 

jCoaGlusions 

' K . ■ 

The package concept was not fully implemented during the spring. Never- 
jthejess, sufficient information about package effectiveness was obtained to 
convince development "staff that the concept is sound and to enable mea,ningful . 
revisions before the 1975 school year. Specifically:'' * , 

.1. It is likely that some confusion over package usage oc(^urred because 
of the varietyof formats used among, them, Package fojmats have been 
standardizfd (using the information gained) to min^mjjje the effort 
necessary for students to usg them. 

2. Package goals have been restated so that they clearly present (1) re- • 
• quirements in basic skills, problem solving, and career development 
, tbat are common to all packages; and (2) those requirements peculiar 
to the specific package. 

3f Several of the packages have been augmented by the inclusion of more 
- sample projects. In particular," the'Social Science Package (Politics) . 
now includes sample projects indicating the celationship between the 
American government equivalenpi^-requi red for graduation and the package 
subject area. The Conmuni ca^i ons and Media Package is now being aug- 
mented by sample projects in the areas o"f Fine Arts, Performing Arts, 
and Crafts. 

4. Policy has been adopted to require any student project that falls 
within the scope of one of the package categories to meet the soals of 
that package. 

5. The role "of package coordinator, along with the structure and activi- 
ties prescribed for package discussion groups, was included as' a topic 
under Student Guidance in the staff development sessions during August 

'1974. 
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Resource Developnient and Mgiintenance Procedures ^ 
Prel imi nary Speci fi cati on 

There were two basic objectives for resource development and maintenance 
during FY 74: 

1. to assure that the resource pool be of sufficient size and breadth, 

, in terms of career families and knowledge areas, to facilitate the ^ 
RWS instructional program; and * . «^ - ^ • • 

• * * 

^2. to define procedures to guide future individuals/institutions in 

the development and maintenance of resources for an experience-based 
career education program. ' • ^ 

« 

1»he procedures encompass the following tasks: 

1. identifying a need for a resource, 

2. locating and recruiting a resource to fill that nee*d, ^ - 

3. developing and analyzing the potential of the-^esource for student 
learning, and 

4. maintaining the resource as a program participant". 

Resources are recruited, (Jeveloped, oriented to the program, and maintained 
by the resource analyst. - ' ^ * • * 

Evaluation Test Plan " . • • 

* » 

Procedures td be used in resource contacts were specified at the outset 
of the 1973-74 school year. ' These procedures were used to recruit, develop, 
and maintain the resource p6.ol thrOtighout .the ^ear. A test plan for formative 
evaluation of- thp pro^edure%wais constructed involving intermittent collection 
and eval uation^f -data on res'ource development and usage. The 'plan is composed 
of the fallowing .six methods of data coll^pt'ion:- * ^ _ ^ 

1. ^ear-end student interviews elTciting s-tiiclent opinions on the size <tj 
and breaclth of the resource pool ; - ^ ■* ■ ^ ^ 

2. review of records on the amount of usage of RPs/ROs by students; 

3. year-end interviews with LCs eliciting informatioa. on .the"" sufficiency 
of resources (especially tho$e. related to packages);, 

4. contacts with all resources to gather, their suggestions for" tmproviing 
" > prbgraim procedures 

■> . . • • • 

5. implementing and monitoring a summer resource recruitrhent/ development 
effort by two untrained staff members following the procedures as * 
written; and 

6. submission of the five package? to associated resource?^ for revief/. 
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Data collection was accomplished during summer 1974, However, processing 

and analysis'of the data ^is scheduled for Tall 1974, so that the findings 

i 

reported below are fragmentary^ ^ • , ^ ^ 

• ♦ • 

Findings 

At the outset of the past fall semester (September 1973), there were 70 
volunteer RPs available for student use. The number was increased' to 103 at 
the start of^the spring semester (february 1974), The current figure (September 
1974') is 134, In the, fall of 1973 there were seven active ROs; thejiuihber was^ • 
increasecj to 12'i>n'the spring. Currently there are 23 ROs available. Table 5,13 
jhows the developmellt of the resource pool during the past year, 

Currently, thfe active pool of 134 RPs represents 109 organizations, including 
41 commercial concerns and 68 nonprofi t organizations , The size of organizations 
represented by RPs included 10 organizations with. 10 or fewer employees, 64 or-, • 
ganizations with 11 to 50 employees, and 35 organisations with over 50 employees, 
of the 23 ROs committed to work with students at the end of the fiscal year, 11 ^ 
are nonprofit and 12 are commercial concerri^s pfour employ fewer thali 10 persons, 
11 have between 11 and 50, and eight employ over 50. 

- * . TABLE 5.13 

* RESOURCE PERSON AND RESOURCE ORGANIZATION DEVELOPMENT, 

SEPTEMBER 1973 THROUGH AUGUST 1974 ' ' - 



Type of Resource . 


Fall 1973 


Spring 1974"" 


Summer 1974 , 


Current 


Start 


Gain 


Loss 


• Start 


Gain 


Loss 


Start 


Gain 


Lo^ 


Pool 


Resource Persons 


70 


55 


22 


103 


47 


20 


130 


19 


15 


134 


Resource 

Organizations " 


7 


6 


1 


12 


10 


0 


22 . 


3 




23 



The figures of Table 5.13 reveal that over 50 volunteers dropped from active 
RP status during the past year. Table 5.14 summarizes the reasons for RP lofes 
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and indicates 'the amount of success attained in replacing the withdrawing RP at 
that' site. 



TABLE 5.14 , 

REASONS FOR CHANGE "iN STATUS, OF. RESOURCE PERSONS 
• FEBRUARY 15, 1974 - AUGUSTS!, 1974 





9/1/73^ 


2/15/74 


d/ \v/ - 


.0/ 1 a/ / H 


6/16/74*- 


8/31 ?74 " 


• 

Reason' For Thange 

• 


Number of 

RPs 
Dropped 


MiimKov* C\'T 
n>JiniJc: 1 U 1 

" RPs 
Replaced 
at Site 


Niirnhpr of 

RPs 
Dropped 


dumber of 

RPs 
Replaced 
at Site 


Number of 
RPs 
Dropped 


Number* of 

RPs 
Replaced 
at Site 


Changed jobs 


9 


7 


10 


3 


4 . 


0 


Lack of time to work 
with students 


A 


9 


0 


0 


8 ^ 


1 


Students not keeping 
appointments 


0 


0 


4* 


0 


0 


0 


Temporarily 'inactive 
or unable to contact . 


2 


0 


1 


0 . 


2 


1 


Becaine^RO Coordinators 


• * 3 


0. 


4 


0 


1 


0^ 


Another RP at site 
'primarily working 
with students 


2 


2 


0 


0 


0 


• 0 . 


Rejected by staff 


1 


0 


' 0 


0 


• 0/ 


•° 


Deceased 


1 


1 


1 


0 


0 


0' 



Three individuals expressed two reasons for their change to inactive" status. 

4" ' ' 
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> 

The most common reason for wi tjidravyi ng (23 cases) was a change in jobs. 
Most other RPs (19) ^dropped tecause they .lacked the tirne td work with students* 
Three RPs expressed two reasons for withdrawing from th^ program; in ^ch case 
they were the lack of time to work with students and the 'failure of stud^rvts to 
keep appointments. Learning coordrrjators continually urge students to inform. an 
"RP when a visit must be cancelled- Where RPs did drop it was often possible to^ 
replace them with another, person^at the same site (30 times). 

Three^ resource organizations became inactive^^in the school during the year^ 
Two dropped for lack of time to work with students. ^^Another, a nonprofit organi 
zation, was not refunded, " . 

Development efforts of the staff vjere directed toward increasing the avail- 
able RPs and ^^Os in those career families where resources were scarce. More re- 
sources were recruited in the career fields that would help students plan pro- 
jects in subject areas required for graduation by the Oakland -Public School Dis- 
trict. Table 5.15 shows the distr^ibution of RPs and ROs by career family in 
September' 1973 and in February 1974. It can be seen that there were injireases 
in the number of career families represented by RPs in all families except con- 
struction trades. Jhe number of career families available within ROs also in- 
creased. ' - 
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• Since March 1974, the RPs and ROs have been catalogued by their associated 
.Teaming packages. Table 5.16 s|iows how the numbers, of RPs and ROs in each -pack- 
age v/ere increased during the spring and summer. Some resources offer knowledge 
in more than one package area, and so are listed on each application package' area. 



table' 5. 16 

v 

DISTRIBUTION OF RPs AND ROs BY LEl\RNlNG PACKAGE AREA 
FEBRUARY 1974 THROUGH 'AUGUST 1974 



4f Packages 


On ftand As 
Of 2/-15/74. 


Rectui ted 
2/16/74 - 
6/15/74 


On Hand As 
Of 6/15/74 


.Recruited 
6/16/74 - 
8/31/74 . 


On Hand As 
Of 8/31/74 




RP 


RO 


RP 


RO 


RP 


Ra 


RP 


RO*' 


RP 

V 


RO 


Conmerce 


22 


4 


8 


■• 4 


30 


8 


12 


1 


39 


9 


Biology 


18 


3 


' 3 


0 


21 


3 


0 ■ 


3 


2T 

• 


6-^ 


Phys i cal 
Science 


22 


2 


2 


2 




4 


4 


0 


25 


3 


Social Science 


24 


5 


12 


4 


36 


9 


22 


4 


53 


12 


Communications 
Medi a 


23 


6 


5 


0 


28 


6 


11 


1 


37 


7 


Resources not 
included in 
packages 


7 


2 


16 


2 


23 


4 


0 


0 


23 


■ 4 



NOTE: Columns do not total, as some resources are included in more than one " 
•package area. 



Resources available for student projects in the packages range from a high of 65 
for Social Science to a low of 27 for Biology. Social Science encompasses the 
OPS grad'uatibn requirements for American government and American history; biology 
.*is not required for graduation. 



' Conclusions' 

Full assessment of the effectiveness of the procedures awaits analysis of 
the data collected under the Test Plan. However, early examination -of the in- 
formation suggests that, overall, the procedures are gffective in locating, de- 
/yeloping, and maintaining the resources required by the FWS program. Two facts 
point toward this conclusion: 

1. the number of resources projefted by instructional and development 
> . staffs .as necessary far the^l975 program'have been located and de- 
veloped; and' ' ' ^ 

b * 

^ 2. sufficient resources have been- located in the various career families 

to implement the five packages: 
« • 
Development of the FWL-EBCE Institutional Form 

The instituti,ohal form of f BCE encompasses organizational and. administra- ^ 

tive arrangements that enable the ^instructional guidance system to o^tcomplish 

program objectives. The current forni wa;s developed during FY74. No test plan ^ 

♦ I. * , , 

for formative evaluation of this development was specified. Rather, the insti- 

tutional form emerged as a result of /del iterations of the Design Control Goinmit- 
tee and the Policy Advisory Boar^j. These <le liberations ranged from highly spe- 
cific problemrsolving where decisions had immediate impact on FWS, to considera- 
tion of policy issues that affect the long-^term future of EBCE. As with most 
management decision-making, problems" were occasionally dealt with where no per- 
suasive evidence existed or where conflicting evidence was apparent. In such 
cases, the long-term EBCE goals were the principal guide, and ambiguity about 
institutional form was tolerated. Decisions 'concerning form were sometimes 
made viewing potential student-learning outcomes as sufficiently important to 
risk" possible future conflicts within the educational system. If continued 
ambiguity about institutional form would allow future EBCE adopters a wider - 
range of Ijocal. .lopttpns,, then this flexibility was viewed as desirable; however, 
flexibility that'wo'uld permit modification .of the major elements of the in- 
structional/guidance systeui, containing the essence of the EBCE concept, was 
viewed as not 'desirable. 

School Relationships Requirement 

Preliminary Specification . The Operating. Plan FY74 discussed school rela- 
tions largely in the context of working<^arrangements w.ith the Oakland Unified 
chool Distriqt and with the Califoiriia State Department of Education. The pre- 
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]iminary specification of requirements*, therefore, ^vSs based upon this relation- 
ship and was presented as follows: 



Board of Eduoatum Contvol ^ EBCE, when- adopted J n whole or in part by' 
a local school di stV'ictj wi 11 fitwij:hin the regular d^ecis ion-making structure 
of the local board of edycation . ^ • ' * 

k 

Separated from Hi^^-School. Organizationally* EBCE will be'a separate 
entity from, but coequal'wi th, any local high school, even.though no new or 
separate -s^ie^^i IV be required, EBCE can be operated in office space tPv.at 
is currently ufWer-util ized or in any building owagd (or rented) by the 
district that is^^'Tro* cuFi?ently fully occupied, 

* ' * • 

Regular School Counselor. Each student (drawn frSfo graded 10-12) must - 
be "registered" formally at a local h-Wgh school and be, assigned to a regular 
counselor. If several EBCE students 'ax;e drawn frorn^a single high School 
register and happen to be assigned to aifferent cdSoselors at that school/ 
it is advisable that all 'be reassigned to a single, counselor for administrative 
convenience. 

Liaison. EBCE wi 1 1' be subject^ to an iinusual degree of external evaluation 
for the 'next few years since NIE is-'col lecting and analyzing a Urge quantity 

data through its contractor, the Laboratory. Hence it is desirable that 
one school -district liaison peiason be assigned to temporary , "in residence" duty 
with the ERCE program until NIE-mandated data collection has been, completed, 

* ' • /'* - * 

Credits. The school district's' list of required course work by grade \ 
level will be used as the basis for assisning cre'dits for project activities and 
products completed by studer)ts, after appropriate 'analysis and evaluation by 
EBCE learning coortiinators*, ^ , . • 

Graduation. The student who successfully , completes the-equivalent of all 
required high school credits will gradua^t?, frpm the Far West School (EBQE- 
operated) and also from' his own local high school- ^ ^ 

, ' Att^yidjxAOe.- Weekly formal student attendance reports will be compiled and 
reported to' the various "originating" high schools and,**thus, to the district 
office* ' 



Junior College. Each semester a student will be permitted to»enroll in 
one course offered by a local junior college. ' 

Finncdpal. The directpr (principal) of the Par West School will meet 
regularly with othqr district high Schoo-l principals and serves on 'the district- 
wide administrators* coinmittee, " 

Reoovda Coovdinatov. The EBCE' records clerk will regularly coordinate- 
with central office*and high school records personnel, thus assurirt>a comtinuity 
and articulation in data processing and record-keeping. ' 



employing 



E^CE will feed into and regularly use the district's computer system, 
ying the usual district foraat for all transcripts.. 
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student Body Membership. On an optional .basis , each EBCE^ student wHl^ 
enjoy the privilege of's.tudent body membership and activities '(e.g., athletic 
events, dances, and so forth) at his/her origjnaT high school. 

^ Senior Caunselors. Learning coordinatoVs will give special emphasis to 
the graduation requirements for each senior, to ensure that all basic criteria 
are b^ing met without any slip-ups. ^ - • . « 

Library Resources. EBCE students will use both school and public-^.llbrary 
resources, as well as j:he modest collection of special materials available in ^ 
the^EBCE\res.ource center. ^ . " 

Folioy Board. EBCE has its own Policy Advisory Board which has evolved 
so as. to represent all groups concerned with the' program. Representatives 
wilThp chosen to represent parents, students, organized labor, resource 
persons, resource organizations,, community resources, and professional and 
individual entrepreneurs. 'This board has several goals: helping to recruit 
new learning resources in the community by suggesting new names and ways of 
approaching organizations; helping to publicize EBCE in the community so that 
it will acTiieve legitimacy; helping to 'preserve the integrity .of EBCE, through 
dynamic tension; an'd sLerying as rep^resentati ves of and sources af feedback to 
all l^al coTistituencies. . - * 

Specification Revfew . The preliminary description of the school relation- 
ships was r4viewed at the end of the school year, and it still appeared to ]De 
an accurate description of the FWL-EBCE jnodel ; however, the site-specific 
nature of the specifications was very apparent. Additionally, the input from 
the Stakeholders Council and the potential adopters indicated that sortie varia- 
tions in school relationships .will exist among future' adopters of EBCf. . ^ 

• Conclusions . As the detailed outlines were prepared for each of the 'hand- 
books which would document the,stabilized mddeV, many of the specified school 
relationships were found to be inherent in the instructional /guidance system; 
hence, special or additional descriptions were not needed. Two topics, -how- 
ever, did require extensive documentation: (1) the policy advi^sory require^ 
ments were developed separately in another work unit and were Included in the 
External Relations Handbook , and (2) the liaison requirements were -documented 

in the Administration Handbook . ' • ' s , 

• " ' » * <j 

». * 
Staffing Requirements 

Preliminary Specification . The Operating Plan FY74 included a staffing 
pattern for the operating unit as follows:* 

HrcQtor of Operations. ^ Manages the Far West School operation and super- 
vise? a staff of seven. Has overall technical and administrative responsibil- 
ity for apiDlying the resources, procedures, and mikerials of the Far West model 

. ' ' ■ ■ , '^^^ 
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to the education of 50 students. Represents the school and EBCE to the business 
community, the public schools, and parents. Holfls California a,dmini strati On 
credential . i," ^ 

Ctudcnt Advisors. Each 'advi sor* is responsible for the planning, facili- 
tation, and monitoring of the individual learning programs 15-20 Students 
in accordance with procedures prespecified by development and evaluation per- 
sonnel and as approved by the Design Control Cgirvni ttee . ^ 

-I , ^ 

Basic Skills Specialist. Responsible for adnrini stra'tion and,, interpreta- 
tion of tests of ba^sic skills as well as interest inventories anrf other diag- ^ 
nostic instruments. Analyzes individual needs in basic, skills development 
and prescribes appropriate supplementary learning activities. Assists advisors 
in planning individual programs and assessing student progress. 

i 

Resource Specialist. ^ Maintains all information files on learning resources 
including RPs, ROs, CRs, and instructional matejials, and assists advisors, and 
students in selecting and using materials. ^Assists advisors in facilitating 
and monitoring learning activities. 

Record Clerk. Maintains all information files on students, including 
schoo-1 records, diagnostic information, individual learning plans, activities, 
and progress. Coordinates flow of information from student to advisor, 
developers, and evaluators.^ 

Specification Review > Early ,in the school yeaV, the* Design Control Com- 
mittee determined that the staffing requirements needed reevaluation anci that 
more extensivi documentation would be necessary to .communicate adequately each 
of the staff roles. While this need was seen for the'^entire spectrum of 
positions, it^s most evident in the case of the learning coordinator (LC), 
a job title which replaced the previously used student advisor title. A re- 
cruitment effort in August 1973 for a third LC provided important inpyt to the 
revision a^nd elaboration of staff roles and functions. 

During Jhe second quarter, a more systematic review of the staffing re- 
quirement was begun. The plan was as follows: 

1, The Labo^ratory's personnel administrator reviewed the personnel 
file of each operations staff member, and prepared copies of the 
job description* reports of Work Planning Conferences and Perform- 
ance Reviews, The most valuable part of the file in developing 
the specifications for EBCE. staffing is. the report of the Work 
Planning Conference, a memorandum including: 

a. a statement of present duties and responsibilities; 

b. a stateinent of the staff member's goals and objectives 

for the rvext yedr; i 

c. a statement of the specific criteria to be used in judging 
per'formance at the next performance review; and , 

. , . ^ - '^ " . ( <) 

. ^ ^ * •* 

*Learning coordinator * , 
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d. a statement of ways in -which the staff member might be 
\ assisted by the supervisor in achieving the objectives. ^ 

2. Th'ese documents were reviewed by a senior member of the FWL 
management team (not an EBCE staff mamber) who prepared 

" narrative descriptions of the job requirements for the director 
of operations, learning coordinator, skills -specialist, resource 
center special ist^ secretary, ancj records clerk. , 

3. * During the third quarter, these descriptions will be reviewed - 

and revised by the employees now in those positions, and EBCE 
staff (with the help of 'the Laboratory personnel 'office) will 
revise the descriptions to ^fit ^ .standard forinat.^ Then 'the' 
personnel -office uf Oakland Public Schools. will review the^ . , 
^ descriptions and suggest modifications needed to enable their 

future us>e within the Oaklan^l system. ^" . \ . 

4! Also during the third quarter, an EBCE team from the evaluation 
. and development staffs will review the specifications to determine 
whether sufficient emphasis is given to the unique EBCE character- 
istics of staff/student interdiction. ^ 

The internal review was completed* as planned; however, the review 'by ^ 
Oakland school staff was done by the liaison administrator and the OPS Director 
ojf^Pupil Personnel Services, .both of whom participated in interviews of 
candidates for open Far West School positions. 

Several additional steps were included in the specification review process. 
First, three alternative staffing patterns were examined by F'ar West staff and 
certain, members^ of th^Oakland school staff. They were useful in preparing the 
^G^st-Comparison Study orTEB&^plication '(Appendix B). .Second, a study of the 
learning resources information system was done by an outside consultant who 
examined the career information delivery systems and classification schemes, 
and' also submitted a recommended task analysis of the personnel requirements. 
This study was believed to be necessary following the FY73 evaluation finding 
that the resource center* was not well utilized. Third, in July 1974 two version? 
of the. .LC job descriptions were compared in terms of format, /depth of treatment, 
and amount of detail;, one version included much more detail on'the guidance 
function. Fourth, the Design Control Committee gave a special review to the 
staffing requirements prior to the specification of the FY75 performance test 
parameters* 

Conclusions . The. staffing requirements for the Far West EBCE mode-1 were 
specified in detail in the Administration Handbook , and the preliminary speci- 
if i cations were modified as follows: 

. . 'MO 



The title, learning toordinator (LC), replaced student advisor, and 
the staff/student ratio was raised to 25 students for each, LC. There 
was support for 'this change from all reviewers and from' operations 
staff members; it is believed to be feasible now that LCs need not 
spend' so much time on mode] development. 
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,A new professional position, resource analyst, was added,, and the 
Fonner clerical position, resource specialist, wasi deleted. This * 
two-part decision was based primarily on^the need to increase- the 
resource development and maintenance capability for the instructional 
staff. . ' . ^ ^ 

4 

There was also relevant but conflicting impact from the outside 
consultant study of the learnilig resources information* system. This 
study sugge§,ted that the under-utilized resettrcfe^refiter be enlarged. 
The consu-1 1 'nt*s report recommended a system^ that v/ould have exceeded 
cost constraints, would hav.e resulted in a center that .dupl icates ^ 
existing resources, and would have the effect of directing students 
inward to the center instead of outward to the larger community. 

3. The recorder clerk was retitle^i rdl^der, a change to match the 
' Oakland school terminology, r* 

4. The comparison'^ of the two descriptions of the LC staff role by 
members of the Design Control Committee resulted in a decision 
to use the version thought to be most useful for recruitment 
insteact of the version which detailed the guidance function. 

5. The Cost-Cpmparison Study (Appendix B) was published showing 
staffing plan'for EBCE programs serving 100, 250, and 500 students 
each. ' ^ 

4 

Policy Advisory Re quirement 

*^ — — — -"^ — 

Preliminary Specifications , The Opera ti ng Plan FV74 did not include pre- 
liminary specifications; however, it did include plans and projections for the 
further development of this important requirement/ Preliminary specifications 
were contained in two internal documents: a staff-prepared draft of a charter> 
and a paper, "^Relationships Among ^Governing and Advisory Bodies, J^ar West 
Career Education Program." ^ ' 

Sjiecifi cation Review . The Policy Advisory Board itself was the principal 
reviewer, and the board deliberations Here i> fact the formative evaluation 
activities which resulted in the study ol; the preliminary specifications aiKl 
the subsequent step-by-step acceptance, rejection, or modific^ation of tne 
specifications. Major issues^reviewed were: (1) how to provide more effective 
advice to school operations, (2) how to involve EBCE parents and students, (3) 
size of board, (4) conmittee -structure, (5) effectiveness of meetings; and 
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\yy "(6) breadth of representation. The board established a standing committee on 
institutional form and gave it the responsibility for s'tudy of these issues,- 
requesting recommendations for total board action/ 

. Conclusions . Before the end of the second quarter, significant progress 
had been made in refining the policy advisory requirements. The staff-prepared 
draft of a charter was rejected, and a new one was -prepared and addpted. Parents 
and students were represented. Board membership balance (age, sex, arfd ethnic 
affil^tion) was improved, as was its representation of a variety of careers. 
The board clarified its purpose as being advisory and not governing. 

At the end^Df the school year, the board had stabilized its, operation so 
that the documentatfon in the External Relations Handbook could include a section. 
Policy Advisory Board Strategy, that recommended steps for forming an interim 
board, and subsequently an ongoing, fully constituted board. .The strategy cites 
successes and failures of the Far West experience, but is also a gu,fde for po- 
tential adopters of EBCE. ^ 

# ' ^ * ^ 

*• " ' 
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V '* ' ' . -CHAPTER 6: SUMMARY AND CONCLUSIONS 

SUMMARY' - ^ , ^ 

* In the In^r^^dbction to this report, seven goaU were present&d for use 
in evaluating 'the Far West School program. Much of the information gathered 
and analyzed in subsequent chapters" has been^ organized, sunimiTrized, and re- » 
lated to the following goals: 

1 . Student progress in self-development > 

a.' Parents of FWS students rated FWS most effective in its ability 

to develop positive self-attitudes in students and in malcijig stu-* , • 
dents , assume responsibility for themselves* Many parents reported 
student growth in, self-confidence, poise, independence, and moti- 
vation to learn* • ' ' . ' ^ 

-» • • 

, b. FWS students reported that they are treated as eMults and that 

they like making their own schedules, having freedom and independ- 
ence, and being free from interpersonal' conflict at the school. 

c. Significantly more^ FWS than comparison students said their self- 
confidence had ij:icreased during the year and that they felt they 
-could express themselves more effectively in a one-to-one situa- 
tion. More ?MS students believed they had learned about them- , 
selvgs because tbey had Md to think for themselves more often, 
and more FWS students attributed increased self-growth to the ac- 
tivities in the school than did comparison students. FWS students 
said the school had been effective in helping them assume respon- o- 
sibility and in evalueTting l^eir own performance and activities. 

2 . 'Student progress in career^development . 

a. Significantly more FWS students than comparison students felt that 
their school had helped prepare them for work, for collegeT and 
for making post-high school plans. Almost 90% of FWS students'" 
said that school had helped them in planning for their future, 
while about one-half the comparison students said this. A signi- 
ficantly larger number of FWS students than comparison students 
reported that they had also talked about their plans with people 
who were working in fields of possible interest. 

b. Many FWS students have shifted their plans- in the direction of 
"keeping their options open" by continuing education or training. 
l)ie percent of comparison students who had apparently chosen spe- 
cific jobs was significantly higl^er than was the FWS student per- 
centage. J * . ^ 

c. Over one-third of the comparison students said that they saw no 
' relevance of their school program to their plans for the future. 

No FWS student made such a statement; on the contrary, FWS stu- 
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dents rated' learning about future careers as the second most im- 
portant feature of Far West School. 

^ * 

d.^ Jwo-thirds of the resource persons said they 'thought the exper- 
i/^.iences at* the resource sjLtes had been worthwhile for the students 
and, nearly half said that the students they worked with had in- \ 
creased their job knowledge and abilities. 

3. Student progress in the deve1opn)gnt of interpersonal skills , 

a. FWS students expre'ssed the opinion that the EBCE experience had 
been effective in increasing their ability to "communicate with 
people in a-mature way," and to work with others, and had helped 
them to improve their interpersonal skills'. FWS stiJ^ents also ■ 
'rated the school significantly higher mth respect to having 
helped them learn to get along with others than 4id comparison 
students in rating their schools. FWS students rafed the school 
higher than comparison students rated their schools with respect • 
to the extent that it helped them meet and deal with people, but 
the difference was not statistically significant. 

h. Of the changes in self listed- by FWS students, the kind of re- 
sponse mentioned most frequently was self grow'^t), 4s indicated 
above. Second in frequency was fnterpersona;l sfciVls. Other cate- 
gories were academic learning and future plajinirtg. 

c. Resource persons, in their ratings of effectiveness of 15 aspects 
of the .program, ranked work with others and irrtproved interpers.onal 
and social skills as among* the most effective, / 

4. Student progress in the development of basic skills . 

a. * Written communication . On the basis of a writing sample judged 
for quality by independenit raters, FWS students ^showed a very 
significant increase in their knowledge of the mechanics of writ- * 
ing, their ability to communicate effectively in writing, and the 
^ ^J^^turity of their written thoughts. When students rated {heir 
school with respect to help received in improving writing, FWS 
and comparison students did not differ significantly. On an inter- 
» view rating, FWS students rated the schooTs help in improving 
writing low-relative to other accomplishments, although they^did 
consider the school's help to , be .satisfactory. It seems clear 
that FWS students do improve their writing skills, but there is 
^ no reason to assume FWS is either more or less effective than 
comparison schools in'thi^ regard. 

' b. Reading . Results for reading essentially parallel tfiose for writ- 
*ten communication. On a standardized reading test, FWS'Students 
did impme their reading skills but not significantly more or * 
* ' ^ less than comparison students. There is virtually no important 
^difference between the two groups with rgspect to their opinion 
about how much the s.chools helped them or how much reading skill 
they had gained or lost during the year. Again, it seems clear 
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that the FWS experience does not result {n any disadvantage rela- 
. tive to students in more conventional high schools, 

c. Quantitative skills . The results with respect to quantitative 
skills for FWS students are essentially the same as for the other 
two basic skills. FWS student effects are not significantly dif- 
ferent frtfm those obtained by comparison students, -with the excep- 
. tion that FWS experimental students rated their program as signi- 
ficantly more helpful in mathematics than did the^^comparison con.- 
trol students."^ ^ ^ 

Student progress toward graduation , 

Ihe FWL-EBCE approach to individualized curricula was jsufccessf ul 
in organizing learning activities and facilitating the assessment ^of 
student achievement and the awarding of credit. The mean number of 
credits earned per student was 5.18, where 5 credits per-year is re- 
quired for graduation*^ One-third of the students who ^completed the 
year earned *6 or more ^credits. . ' • ' 

Keeping students in school . ^ ^ 

a. Sixty-one students wfere enrolled at Far West School at the open- ^ 
ing of the 1973-74 school year and one former student returned at 
the beginning', of the second semester; During the year, seven stu- 
dents transferred from Far West to other high school programs. 
Three students withdrew from school --one for health reasons, one 
to travel, and one to take full-time employment. Three«.students 
graduated at midyear'. At the "conclusion of the school year> en- 
rollment was 49."" 

b. Eighty-five to 90% of FWS students expressed a ^strong, preference- 
for FWS in comparison with schools they had attended previously, 
and said that if again faced with the choice, they would apply to 
FWS. The major reasons for this preference can be sunniarized as: 

(1) FWS provides much more practical experience and education, 

(2) FWS allows more individual freedom and responsibility, (3)* FWS 
provides opportunities to learn nbout occupations, and '(4) FWS is 
much warmer and friendlier than regular schools • When asked to 
rate school characteristics, 75% of the FWS characteristics were 

< rated positively and none was rated negatively by FWS students; 

comparison students rated 29%' of the characteristics positrvely 
^ and 50% negatively. 

Achieving community- participation and acceptance . 

a. People who served as learning resources were generally positive 
in their statenients aboat the EBCE concept, about the school, and 
about their own participation. A large majority intend -to continue 
to serve and would' recoriimend to others that they become involved. 
Only one resource person said he was dissatisfied with the student(s) 
. who had come to his site. More than half of the RPs said ^hey 
thought the students had made apRropric|te use of the opportunity 
provided at a specific site. A frequently cited criticism was in- 



sufficient communication With the school. Many resource people 
' also felt that students v/ere not diligent in, meeting commitments ' 
- and taking full advantage of the opportunitT^s offered at the 
learning sites. 

* 

' b. Parents of FWS students vere generally positive in their statements 
about Far West School. A large majdrity stated that if they had 
the choice to make again,^ they would want their son or daughter 
...participating in the program. They gave positive ratings to the 
^ 'school staff and to J;he participating business and community re- 
sources. Parents rewgnize'd as strengths of the program the es- 
sential features of EBCE: experience-based, career-oriented, in- 
dividualized, 2K\d varied involvement with adults. Although parents 
are highly J^upportive of EBCE, they tend 'to retain most of the typ- 
ical parental concerns about the achievement of community-held 
views of the purpose of education in American society. Parents 
seem to appreciate that-&BCE inspires new enthusiasm in students 
about school, but still expect students to learn basic skills and 
acquire the normal subject-matter knowledge. 

c. The Oakland school system is very supportive of EBCE, and its ad- 
ministration expresses interest in the development of entry strate- 
gies for bringing EBCE to a larger number of students. 

In addition to findings related to stated program goals, certain other eval- 
uation results were presented that are' sufficiently important to be eiilphasized. 
Some of these findings reveal design or implementation flaws requiring remedial 
action; in these 'cases the accomplished or recommended actions are indicated. 
(Other plans made and actions taken as a result of the evaluation are presented 
in the EBCE Operating Plan FY75 .) 

1* Anthropological observations , 

«► 

From observational data collected over a pehiod of several weeks 
by two of his graduate students in anthropology, Stanford professor 
George Spindler concluded that: 

a. "The e\n_dence in the report clearly indicates that Far West School 
is achieving its aims quite well, p.erhaps extremely well." 

b. "Far West students ace learning from each other and through casual 
encounters as well as in their encounters -with RPs." 

c. "The report contains the beginnings of a total network analysis ■ 
. for the systeiii, but... should be pursued much further." 

Rgcommendations . (1) A more explicit provision should be made in the 
model for peer-learning opportunities, and (2) the suggested follow-up 
anthropological study should be conducted in FY75. 
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2. Staff phi1osophv « 

Key staff members have similar positions on major issues of educa- 
tional philosophy as defined by the Pos^tman-Weingartiier conventions. 
However, there are significant differences ainong^staff members in the . 
perceptions of actual practice at FWS, 

Recommendation . Augmentation of staff training should include' attempts 
to achieve common understanding of key terms and to establish agrsed-\ 
upon objectives and standards for sxhool operation. \ 

3. Resource development , . ' * 

Procedures for locating, developing, and maintaining resources 
were successful. The number of resource persons increased from 70 to 
130 aad the number of resource organizations from seven to 22 'during 
the twelve-month pe.riod ending August 31 , 1974, 
« ' * 

4. Studeotiftactivity levels . . ' ^ 

Students* mean progfam activity was above the .established- staYid- 
ard of 25 hours per week^ even so, most students were not spending as 
much time at resource sites as the model prescribed. Using students* 
own reports, of their activities, the mean of student resource activity 
was 6.5 hours per week, well under the standard 12.5 hours (50% of the 
students' program activity) . Learning coordinators seemed •satisfied 
with the. amount of student-resource activity; LCs rated 32 of 46 stu- 
dents as "high users" of external resogrces— of these 32 students, 
only nine approached or exceeded the 12.5' hour standard. This is an 
indication that the standard for student-resource interaction (50% of 
student time) is higher than is feasible- x ' ' 

Recommendation . The amount of time spent by students in constructive 
interaction with resources should be assessed during the coming year. 
Model design should be reevaluated and based on careful analysis of 
student outcomes documented dunnq the FY75 performance test. 

5- Instructional/guidance system . 

All components of the o'nstructional/guidancc system were imple- 
mented tiuring the year, but with varying degrees of completeness and 
timeliness. 

a. Student diagnosis and orientation did not meet expectations in 
helping entering students understand and accept the basic pro- 
cesses in EBCE and in prov.iding a solid basis for individual pro- 
gram planning. 

Actions taken . (1) Diagnostic procedures have been revised ex- 
tensively. While similar information is still collected (e.g.^^ 
basic skills achievement levels, graduation requirements), the 
lengthy individual diagnostic report was eliminated and various 
inventories and abilities tests are now orti onal • Further, the 
collection and use of such information is now assimilated into the 
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ongoing learning program rather than existing as a separate function. 
Tiius, LCs are able to explain the purposes and nature of tests prior 
to theiy use, (2) Orientation procedures were reconceptualizecl and 
extensive.ly revised. Activities were restructured to first empha- 
size FWS-based activities with gradual expansion to resource-site 
visits.^ Training sessions for instructional staff in use of stu- 
™ ^^"^^^^^ procedures were designed and conducted prior to the 
1974-75 school. year and returning students were invited to assist 
during orientation. Finally, responsibility for resource develop- 
ment and maintenance procedures was transferred from,EBCE develop- * 
ment staff to the FWS instructional staff ..and the time period be- ^ 
tween resource development and student use was reduced. ' 

b. Guidance procedures were inadequately implemented, as indicated by 
A °^ understanding by some students of the planning process, 
ancL(2) cases of inadequate progress monitoring and feedback by 
learning coordinators. 

Actions taken. (1) Complete documentation of guidance procedures ' 
was accomplished through the publication of the, Student Guidance 
Handbook during summer, 1974, (2) intensive review of guidance 'pro- ' 
cedures was undertaken in joint meetings of development and in- 
structional staffs, (3) workshops in implementations skills were 
held for the instructional staff, (4) task priorities were estab- 
lished for learning coordinators and the position description re- 
written delineating tasks and responsibilities- and establishing 
their priority, and (5) monitoring of the implementation of guid- 
ance procedures was established as a major formative evaluation*' 
task during FY75. 

Student project planning . 

Learning coor'dinators varied in their approach to student priD- 
ject planning, as indicated by the number of projects completed, the 
amount of resource activity reported, and the amount of credit re- 
ceived by students. 

Action taken. Intensive s,taff tra.ining/ development sessions held in' 
August 1974 were intended to standardize the learning coordinators' " 
approach to project planning. The success of .this training program 
in accomplishing a consistent implementation is of major concern to 
the program during the coming year. 

Learning packages . 

Learning packages were of limited utility ta the school staff and 
to students because (1) not all packages were available at the begin- 
ning of the year, (2) packages were being developed and revised through- 
out the year,' and (3) package fdrmat and content were not yet fixed. 

Action taken . Package format was standardized, package goals were re- 
.stated to clearly present requirements, additional sample projects 
were developed, and staff training in use' of packages was instituted. 
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Several conclusions can be drawn from'the information presented in this 
t. 

1. Program development and formative evaluation during FY74 have" resulted 
in a documented, stabilized model for the FY75 performance test. Cer- " 
tain program components (e.g., diagnosis, orientation, guidance) were 
imperfectly implemented- duri ng the 1973-74 development year. Forma- 
tive evaluation resulted, in identification of the deficiencies and re- 
vision of. model procedures. j 

2. -People serving as resources for FWS were positive in their support of 

the EBCE concept; sufficient resource persons were located and. main- 
tained to enable implementation of the FWS instructional program. In- 
dications are that future EBCE programs can maintain sufficient pools 
of resourcejs to provide .necessary learning opportunities to their stu- 
dents, t 

■> ' * 

Students indicated, in questionnaires and interviews, that career^ex- 
ploration.was of high interest; however, their amount of activity at 
resource sites was much less than the 50% of their total time expected. 
It may be that ^the expectation of studont activity in the field is un- 
realistic; further evaluation of this feature must be accomplished in 
FY75. 

"4. Many students dissatisfied wi th, rec,jlar schools see the EBCE progranf- 
as relevant to their current and future, needs/ Almost all FWS s«tu- 
dents express a decided preference for the school over their previous 
program. Students' perforinance increased in both quality and. quantity 
of work as they gained experience in the program and adjusted to its 
requil'^ements for personal .motivation , direction, and responsibility. 

5. The EBCE program was successful in providing students with opportunities 
for growth in, the areas of self- development and interpersonal skills. 
Their experiences with resource persons and resourre organizations placed 
them If) interactions in the adult world ia roles where they were accepted 
as young adults and as equals. Students and Resources alike were enthu- 
siastic about this aspect of the FWS program./ 

6. The learning of basic skills did" not' suffer through the elimination of, 
classroom instruction: there was np significant difference in perform- 
ance between the experimental and control groups— this despite the fact 
that the remedial portion of the basic skills program was not fully in 
place until spring 1974. The primary emphasis of the program is on 
skills acquisition throiigh field experience. 

7. Communication beT:v/een FWS and the various elements of the' coiwnunity must 
be imp roved. Resources cite inadequate feedback about the results of 
their interactions with students; parents cite few meetings with staff 
and infrequent reports on the progress of their sons/daughters. .There 
is recognition of this deficiency and correction action has been taken. 
A resource analyst was added to the instructional staff and staff- 
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development sessions were held during the summer in whi ch emphasis 
v/as placed xwi/s^taff-resource ar)d stafT-ffarent communications. 

8. The autcotnes of the instructional program were affected by the dif- 
ferences among the learning coordinators approach to student giiidance. 
Significant grouodifferences were'observed among students assigned 

to the thr&e LC5 nrft' fiumber and size o/'student projects, amount of ac- 
tivity at resource sites, and credit assigned. In order to standardize 
the student guidance within the model , complete documentatioji of pro- 
cedures for stu3ent guidance was developed, and intensive instructional 
sta^f training programs were implemented during* the summer^, 

^ - * * 

9. EBCE model developers and evaluators believe that as a result of being 
in the E,BCE program,' students will exhibit changes in their attitudes^ 
toward the world of work. ' There is little evidence thai: tliis is so>. 
Bringing abou/t changes of this kind has relatively low prioritj' as an 

• objective for students, for parents, and for learning coordinators 
(though not low^for resource^persons) , No consistent changes were 
found using items from the Job-Related Attitudes scale/ -Thfs finding , 
appears unrelated to more positive outcomes noted in other career- 
related variables. ' - 
• 

10. There is a limit to the usefulTness for the EBCE program of group ^da- 
t** collected in the traditional pr^-post, experimental-cdntrol group 
de sign. One of the departures from this design consisted of anthro- 
pol^gTWIsJg^ta collected by observations ^ over a period, of several 
weeks. An ot^erved outcome not reported' elsewhere has to 'do with the 
learning that xJakes place in peer interactions and through- casual en- 
counters with cmults . / ^ 

11. The adminisW^ion of the Oakland school system, which is formally 
associated with the FWL-EBCE program, has expressed growing support 
of FWS and has greatly facilitated* the program* operational 

12. Further development iS needed on instrumentation for measuring EBCE ^ 
program outcomes . . 

\ 
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